Skip to content

test: add local multi-turn coding agent smoke test - #4

Open
aoshen02 wants to merge 1 commit into
mainfrom
codex/local-multi-turn-smoke
Open

aoshen02 wants to merge 1 commit into
mainfrom
codex/local-multi-turn-smoke

Conversation

@aoshen02

Copy link
Copy Markdown
Owner

Summary

  • add a local Docker sandbox adapter for coding-agent rollouts
  • add a reproducible 10-task SWE-bench SymPy smoke test
  • document the H200, Qwen3.5-27B, TP8, 256K-context setup
  • persist per-task inputs, trajectories, patches, grading results, and sandbox events

Scope

This is a rollout-only local experiment. It is not registered in CI and does not change Vime runtime behavior.

Validation

  • bash -n on both shell entrypoints
  • Python syntax compilation for generate.py and sandbox.py
  • JSONL validation: 10 unique task instances
  • git diff --cached --check

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant