Skip to content

Bound native autopilot observation to two opportunities - #151

Open
dfrysinger wants to merge 1 commit into
dfrysinger/echo-task-snapshot-recoveryfrom
dfrysinger/echo-next-native-observation
Open

dfrysinger wants to merge 1 commit into
dfrysinger/echo-task-snapshot-recoveryfrom
dfrysinger/echo-next-native-observation

Conversation

@dfrysinger

Copy link
Copy Markdown
Owner

Adds an opt-in native_opportunity_limit: 2 to the existing capped native continuation evaluator. The default observation path stays unchanged.

The evaluator sends the initiating request once, passes the next native prompt through unchanged, and counts ordinary completions only when the final answer has a matching turn end. It stops at the selected boundary and holds further prompts during shutdown. Genuine task completion, protected input, errors and the original deadline remain separate exits.

This includes the capped source-bound restoration prerequisites used by the continuation path. It changes no target-skill instructions, permissions or time/credit limits.

Verification covers 38 focused owning and legacy checks, including missing/mismatched turn ends and non-final text followed by idle. A native setup performed file, shell and SQL work across two opportunities, then stopped before a third with the objective still active and clean shutdown. This is evaluator setup evidence, not a skill-improvement or reliability claim.

Add an optional two-opportunity boundary to the existing native evaluator. Preserve the initiating send, require correlated final responses and turn ends, pass native continuations unchanged, and stop at the selected boundary without changing the default idle behavior.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: cf89240b-a65d-414a-9123-5c1dc9c40c7d
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant