v0.6.0: Proactive provenance (run-record + node runner) + LaTeX paper standard#12
Open
hebbianloop wants to merge 4 commits into
Open
v0.6.0: Proactive provenance (run-record + node runner) + LaTeX paper standard#12hebbianloop wants to merge 4 commits into
hebbianloop wants to merge 4 commits into
Conversation
Make the Glimmer graph executable, not just descriptive. The agentic loop
(docs/agentic-loop.md) was specified but had no runtime primitive; the only
"verification" script re-hashed files on disk ("not a full re-run").
Core schema (v0.5.1 → v0.6.0):
- new `run-record` node type: one concrete, replayable invocation (PROV Activity)
with a planned → ready → running → executed lifecycle, binding a method + pinned,
standard-validated inputs + expected outputs + command + container digest + a
runner-written verdict. The executable unit of the agentic loop.
- edges reruns/consumes/regenerates/emits (+ inverse regenerated-by); broaden
tests-hypothesis/addresses-concept to allow a run-record source.
- method-registry affordances: registry-ref + implements/equivalent-to/refines.
- standard.validator hint for the runtime gate.
Runner (glimmer/tools/run.py + `glimmer run` / `glimmer rerun`):
- pre-run standards gate (inputs pinned AND valid; validation delegated to each
standard's validator or glimmer validate).
- datalad containers-run replay (feature-detected; degrades honestly).
- three verification tiers: byte-identical (NIfTI/GIFTI/JSON normalization),
numeric-within-tolerance (re-derive published numbers), structural (agent/LLM).
- certify_equivalence, dependency-ordered `all`, provenance manifest, verdict
writeback.
Validator: run-record field/edge/target/lifecycle checks + agent-protocol rule.
Worked example: examples/synthetic-provenance/ exercises the loop + all three
tiers + the gate + equivalence, with no real data and no heavy deps.
Docs: new docs/proactive-provenance.md; agentic-loop.md made executable; roadmap
(federation → v0.7, registry/minimal-path folded in); README repositioned as
AI-native reproducibility; agent-protocol + datalad-pattern cross-linked.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Add docs/paper-draft.md — a working manuscript (no journal boilerplate) extending "Reproducibility as Knowledge Graph Navigation" to proactive provenance: the executable run-record + node runner, the standards gate, the three verification tiers, runtime-certified method equivalence, and the agentic loop made executable. Point paper-citation.md at it and bump the software citation version to 0.6.0. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Establish LaTeX as the standard for submittable Glimmer papers: - papers/glimmer-paper.cls — venue-neutral house document class (preprint/draft banners, title-block macros; preloads amsmath/hyperref/natbib/booktabs/…). - papers/README.md — the convention + build instructions; papers/.gitignore for TeX artifacts. - papers/01-knowledge-graph-navigation/ — Paper 1, scoped to v0.5 (the graph as a navigable substrate; verification as a validator-enforced contract, the executable runner named as forthcoming). Preprint candidate. Compiles to 9pp. - papers/02-proactive-provenance/ — Paper 2 (v0.6): the run-record + node runner, standards gate, three verification tiers, certified equivalence. LaTeX port of docs/paper-draft.md. Compiles to 7pp. Both build with `make` (latexmk + bibtex) against the shared class. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Makes the Glimmer graph executable, not just descriptive, and establishes a LaTeX standard for submittable papers.
The agentic loop (
docs/agentic-loop.md) was specified but had no runtime primitive; the only "verification" script re-hashed files on disk ("not a full re-run"). This PR closes that gap with one core node type and one tool, and lands two manuscripts.Schema (v0.5.1 → v0.6.0)
run-recordcore node type — one concrete, replayable invocation (PROVActivity) with aplanned → ready → running → executedlifecycle, binding a method + pinned, standard-validated inputs + expected outputs + command + container digest + a runner-written verdict. The executable unit of the agentic loop.reruns/consumes/regenerates/emits(+ inverseregenerated-by);tests-hypothesis/addresses-conceptallowed from a run-record.registry-ref+implements/equivalent-to/refines.standard.validatorhint for the runtime gate.Runner —
glimmer/tools/run.py(glimmer run/glimmer rerun)datalad containers-runreplay (feature-detected; degrades honestly).certify_equivalence, dependency-orderedall, provenance manifest, verdict writeback.Validator, example, docs
validate.py: run-record field/edge/target/lifecycle checks + agent-protocol rule.examples/synthetic-provenance/: exercises the loop + all three tiers + the gate + equivalence, no real data / no heavy deps.docs/proactive-provenance.md;agentic-loop.mdmade executable; roadmap renumbered (federation → v0.7, registry/minimal-path folded in); README repositioned as AI-native reproducibility; agent-protocol + datalad-pattern cross-linked.Papers (new LaTeX standard)
papers/glimmer-paper.cls— venue-neutral house class;papers/README.mddocuments the convention.01-knowledge-graph-navigation/) — scoped to v0.5: the graph as a navigable substrate; verification as a validator-enforced contract, the executable runner named as forthcoming. Preprint candidate (9pp).02-proactive-provenance/) — v0.6: the run-record + node runner (7pp). LaTeX port ofdocs/paper-draft.md.Verification
glimmer validateon the synthetic example: 0 errors.glimmer rerun … all→ 100% (verified ×2, reproduced-within-tolerance, structurally-valid).ds000114-nipypevalidates unchanged.make(latexmk + bibtex), no undefined references.🤖 Generated with Claude Code