Skip to content

Connect English delegation to Codex with paired harness measurements - #13

Merged
Noisemaker111 merged 1 commit into
agentsfrom
feature/codex-english-bench-20260910
Sep 10, 2026
Merged

Noisemaker111 merged 1 commit into
agentsfrom
feature/codex-english-bench-20260910

Conversation

@Noisemaker111

Copy link
Copy Markdown
Owner

Connect one scoped English Python delegation tool to a fresh Codex chat through project-local MCP configuration. Each call starts a fresh FP16 worker process and returns observed results and saved evidence to the originating frontier turn. Preserve the exact completion condition in source-generation context, fixing the observed extra-output failure.

Add fresh normal-shell/delegation chat preparation, real Codex JSON event capture, frontier/local token accounting, whole-process timing, alternate-input accuracy checks and qualified pair comparison. Keep failed results, protect existing evidence and detect source changes during runs. No global Codex config or native shell interception.

Verified through real separately persisted Codex chats using the existing ChatGPT login: native CSV baseline, successful English CSV delegation, and real NameError repair. Original and changed-input checks passed. The single CSV pair was 71.075s vs 43.118s and 995 vs 486 frontier output tokens; these are development smokes, not general speedup or billing claims. Earlier startup and completion-context failures are retained and documented. Compileall and 15 core/comparison invariants pass.

This remains a trusted-workspace Windows Python prototype. Desktop UI, general shell replacement, native per-command resource permissions, broad accuracy, and the real PTY recorder remain unverified. The local tool executes generated code with account privileges and advertises that boundary.

@Noisemaker111
Noisemaker111 merged commit 63f413b into agents Sep 10, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant