Skip to content

Record effective guard state in campaign provenance - #313

Merged
slowdini merged 1 commit into
devfrom
issue-306-guard-provenance
Sep 3, 2026
Merged

Record effective guard state in campaign provenance#313
slowdini merged 1 commit into
devfrom
issue-306-guard-provenance

Conversation

@slowdini

@slowdini slowdini commented Sep 3, 2026

Copy link
Copy Markdown
Owner

Summary

  • Record the post-preflight guard_armed value in conditions.json.
  • Derive dispatch.json.guard from that recorded value and carry it into benchmark.json.
  • Render the effective state as true, false, or unknown in promoted BASELINE.md files.
  • Document and test guarded, explicitly unguarded, unstaged, guardless, and historical runs.

Rationale

Published benchmark and baseline provenance names the harness, model, codebase, and skill, but did not say whether the eval guard was active. This makes that validity boundary explicit while leaving enforcement authority and expanded per-task policy in dispatch.json.

Artifact contract

Before:

{
  "harness": "codex"
}

After:

{
  "harness": "codex",
  "guard_armed": true
}

Historical conditions without the field remain readable. Their benchmark omits the field, and promotion renders Guard armed | unknown; absence is not treated as false.

Implementation notes

  • ConditionsRecord.guard_armed and Benchmark.guard_armed are optional for compatibility, but every newly prepared iteration records true or false.
  • run --help and eval-magic docs guard describe the provenance contract.
  • RunArgs and the new provenance tests moved to focused modules to keep their long owner files navigable.
  • No CLI flag or guard-enforcement behavior changes.

Verification

  • cargo fmt --check
  • cargo build
  • cargo test --quiet (953 library, 218 CLI, and 208 run tests)
  • cargo clippy --all-targets -- -D warnings
  • git diff --check

Closes #306

Record the post-preflight guard state in conditions and carry it through dispatch, aggregate benchmarks, and promoted baselines.

Preserve historical absence as unknown and document the artifact contract.
@slowdini
slowdini merged commit e349c7f into dev Sep 3, 2026
7 checks passed
@slowdini
slowdini deleted the issue-306-guard-provenance branch September 3, 2026 01:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Record effective guard state in campaign provenance

1 participant