Skip to content

Verify run manifests before trusting artifacts - #175

Merged
cschanhniem merged 9 commits into
mainfrom
manifest-verifier
Jul 6, 2026
Merged

cschanhniem merged 9 commits into
mainfrom
manifest-verifier

Conversation

@cschanhniem

Copy link
Copy Markdown
Collaborator

Summary

This PR adds a small but high-leverage reproducibility gate: a run-manifest verifier.

The repo already generates run_manifest.json, but a manifest is only useful if someone can cheaply verify that the recorded inputs still match their hashes and that the named outputs still exist. Without that check, downstream review can accidentally trust a stale or partially missing artifact set.

Changes

  • Add openamp_foundry.reproducibility.verify_run_manifest().
  • Add scripts/release/verify_run_manifest.py CLI.
  • Add tests for:
    • valid manifest verification;
    • input hash drift detection;
    • missing output detection;
    • optional output hash enforcement.

Why this matters

This strengthens the repository's evidence layer without adding any biological claims. It makes the existing reproducibility standard operational: the manifest becomes a verifiable object, not just metadata.

Tests

Not run locally in this environment; CI is the source of truth for this PR.

@cschanhniem
cschanhniem merged commit 5fdb14c into main Jul 6, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant