S13: real adapter probes for conformanceCheck; harness identity record (SHIP_HARNESS_RECORD) - #50
Merged
Merged
Conversation
…d (SHIP_HARNESS_RECORD) Probes drive native, claude-code and opencode through durableAgent with a scripted model / fake vendor binary over LocalExecutor and feed what was accepted, refused, dropped or started into conformanceCheck. Unprobed operations are listed, not counted as passing. A credential-lifecycle test checks the forwarded credential is gone from the sandbox after exit. Under SHIP_HARNESS_RECORD=on (default off, off writes no key) run-started gains a sibling harnessIdentity (model, harness, expected revision, configuration digest; names only), shown on the run page next to the revision the preflight step observed. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01VqsBNqvaWezf1DwQrAnVgX
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Changes
src/harness-probes.ts: probes drive native (scripted model), claude-code and opencode (fake vendor binary) throughdurableAgent+ the realexternalAdapters()+LocalExecutor, for plan-review, steer and investigate. Observed accepted/refused/started/honoured/side-effects feedconformanceCheck. Other operations are reported asunprobed(not a pass).src/harness-identity.ts+ 5-line edit insrc/runtime.ts: underSHIP_HARNESS_RECORD=on(default off)run-startedgets a SIBLINGharnessIdentity(model, harness + adapter version, expected vendor revision, configuration digest, forwarded env NAMES only). Not ininput, so the step fingerprint and step sequence are unchanged. Off writes no key.web/src/lib/harness-identity-view.ts) joining the identity with the revision the existingharness-preflightstep observed; flags drift/missing binary. Absent when not recorded.Checks
node --test --experimental-test-isolation=none "dist/**/*.test.js"after a clean build. scripts/grader-sensitivity and pj-b grader were NOT run separately (fixed port 8901; CI runs them).pnpm run buildOK.silently-droppedfor claude-code and opencode, clean for native.Not verified / still open
harnessSupports, mirroring the web route's gate-before-store order; the route itself is not driven.🤖 Generated with Claude Code
https://claude.ai/code/session_01VqsBNqvaWezf1DwQrAnVgX
Generated by Claude Code