🤖 Auto-filed from milestone doc bullet.
Repo: WasmAgent/fresharena
Milestone: Milestone 2 — Research Experiment
Problem
The file worlds/json-transform/immunity-pool-v0.json contains 20+ confirmed counterexamples that fail across baseline solvers. These counterexamples represent test cases that the existing baseline solvers (random-baseline, curriculum-baseline, adversarial-baseline) cannot successfully solve, indicating gaps in solver capabilities or problematic test cases.
Approach
Investigate and resolve the counterexamples by either:
- Fixing bugs in the baseline solvers to handle these cases correctly, OR
- Removing invalid/unfair counterexamples from the immunity pool if they represent malformed test data
The specific action will depend on analysis of whether these counterexamples represent:
- Legitimate test cases that expose solver weaknesses (fix solvers)
- Invalid/unfair test cases that should be excluded (fix test data)
Files
worlds/json-transform/immunity-pool-v0.json - Contains the counterexamplesworlds/json-transform/generator/random-baseline/index.ts - Random baseline solverworlds/json-transform/generator/curriculum-baseline/index.ts - Curriculum baseline solverworlds/json-transform/generator/adversarial-baseline/index.ts - Adversarial baseline solver
Acceptance criteria
- Command
bun install --frozen-lockfile && bun run build && bun run test passes
- The 20+ counterexamples in
immunity-pool-v0.json are either successfully handled by baseline solvers OR removed if invalid
- No unrelated files touched (git status --short output limited to intended changes)
Notes for implementer
First analyze the counterexamples to determine if they represent legitimate test cases or invalid data. Use this analysis to determine whether to fix solver logic or clean up the test dataset.
🤖 Auto-filed from milestone doc bullet.
Repo: WasmAgent/fresharena
Milestone: Milestone 2 — Research Experiment
Problem
The file
worlds/json-transform/immunity-pool-v0.jsoncontains 20+ confirmed counterexamples that fail across baseline solvers. These counterexamples represent test cases that the existing baseline solvers (random-baseline, curriculum-baseline, adversarial-baseline) cannot successfully solve, indicating gaps in solver capabilities or problematic test cases.Approach
Investigate and resolve the counterexamples by either:
The specific action will depend on analysis of whether these counterexamples represent:
Files
worlds/json-transform/immunity-pool-v0.json- Contains the counterexamplesworlds/json-transform/generator/random-baseline/index.ts- Random baseline solverworlds/json-transform/generator/curriculum-baseline/index.ts- Curriculum baseline solverworlds/json-transform/generator/adversarial-baseline/index.ts- Adversarial baseline solverAcceptance criteria
bun install --frozen-lockfile && bun run build && bun run testpassesimmunity-pool-v0.jsonare either successfully handled by baseline solvers OR removed if invalidNotes for implementer
First analyze the counterexamples to determine if they represent legitimate test cases or invalid data. Use this analysis to determine whether to fix solver logic or clean up the test dataset.