Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
126dc7c
cbz: federation reference crawler, a G7 component next to the #712 dr…
claude Oct 30, 2026
708c70e
cbz: reference crawler reads every text file and counts what it canno…
claude Oct 30, 2026
b8994c6
cbz: reference crawler fails closed on incomplete census and conflict…
claude Oct 30, 2026
1ead96b
cbz: hermetic reference-crawler fixtures; mutation harness refuses en…
claude Oct 30, 2026
f91bfb2
cbz: reference crawler fails closed on incomplete topology; kills nee…
claude Oct 30, 2026
c7e89aa
cbz: bind every reference-crawler mutant to its designated tests (B-0…
claude Oct 30, 2026
0160e74
cbz: freeze the reference-crawler test population; fail-map written a…
claude Oct 30, 2026
b41faf1
cbz: reference-crawler harness hashes raw test bytes; fail-map schema…
claude Oct 30, 2026
b3b2da5
cbz: G7 gate blocks on interface drift, with reviewed historical cita…
claude Oct 30, 2026
1ed850b
Merge current main into claude/cbz-reference-crawler-a1G1I
d6g8k5htny-coder Nov 6, 2026
09400b8
cbz: acknowledge five reviewed historical citations for the G7 crawl
d6g8k5htny-coder Nov 6, 2026
b0a10ad
cbz: bind reference mutation kills to traceback provenance
d6g8k5htny-coder Nov 6, 2026
defcec8
cbz: keep acknowledgement matchers non-referential
d6g8k5htny-coder Nov 6, 2026
74c79f2
cbz: validate the registered acknowledgement set
d6g8k5htny-coder Nov 6, 2026
ab64953
cbz: bind mutation fixtures to the registered acknowledgements
d6g8k5htny-coder Nov 6, 2026
95a351f
cbz: shard reference-crawler mutation qualification
d6g8k5htny-coder Nov 6, 2026
e7fc575
Qualify reference crawler mutations in shards
d6g8k5htny-coder Nov 6, 2026
f38ac90
Record exact-head G7 qualification
d6g8k5htny-coder Nov 6, 2026
f7b0d2b
Merge current main into claude/cbz-reference-crawler-a1G1I before pro…
d6g8k5htny-coder Nov 6, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
610 changes: 610 additions & 0 deletions cbz/evidence/reference-crawler-01shcrxv/README.md

Large diffs are not rendered by default.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
start=2026-10-30T19:28:22Z end=2026-10-30T19:30:54Z exit=1
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
reference crawl: 28636 references, 9 repositories, 1 blocking; counts {'CANDIDATE': 4, 'FOREIGN_REPOSITORY': 1, 'FROZEN_CHANGED': 2529, 'FROZEN_REMOVED': 4322, 'JSON_WITH_COMMENTS': 1, 'LIVE_DRIFT': 1}
acknowledged: 401 findings by 21 entries; unused entries []
BLOCKING LIVE_DRIFT main:docs/math_status/STATUS_RN_UNIF.md cited by Math-:frontiers/three_fronts_20260924/SOURCES.json: path absent at 11e28815163e15223e8827fe6ff47a1faaf36ebd
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
start=2026-10-30T19:30:54Z end=2026-10-30T19:33:26Z exit=1

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions cbz/evidence/reference-crawler-01shcrxv/crawl-strict.exit
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
start=2026-10-30T19:25:58Z end=2026-10-30T19:28:22Z exit=1
3 changes: 3 additions & 0 deletions cbz/evidence/reference-crawler-01shcrxv/crawl-strict.stdout
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
reference crawl: 28123 references, 9 repositories, 1 blocking; counts {'FOREIGN_REPOSITORY': 1, 'FROZEN_CHANGED': 2435, 'FROZEN_REMOVED': 4322, 'JSON_WITH_COMMENTS': 1, 'LIVE_DRIFT': 1, 'PIN_SKEW': 4}
acknowledged: 347 findings by 21 entries; unused entries [3, 11]
BLOCKING LIVE_DRIFT main:docs/math_status/STATUS_RN_UNIF.md cited by Math-:frontiers/three_fronts_20260924/SOURCES.json: path absent at 81acc060341e8a31cc4cd4f9523ef71fb6c06175
1 change: 1 addition & 0 deletions cbz/evidence/reference-crawler-01shcrxv/crawl-tips.exit
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
start=2026-10-30T19:43:47Z end=2026-10-30T19:46:20Z exit=1
2 changes: 2 additions & 0 deletions cbz/evidence/reference-crawler-01shcrxv/crawl-tips.stdout
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
reference crawl: 28636 references, 9 repositories, 1 blocking; counts {'CANDIDATE': 4, 'FOREIGN_REPOSITORY': 1, 'FROZEN_CHANGED': 2529, 'FROZEN_REMOVED': 4322, 'JSON_WITH_COMMENTS': 1, 'LIVE_DRIFT': 1}
BLOCKING LIVE_DRIFT main:docs/math_status/STATUS_RN_UNIF.md cited by Math-:frontiers/three_fronts_20260924/SOURCES.json: path absent at 11e28815163e15223e8827fe6ff47a1faaf36ebd
1 change: 1 addition & 0 deletions cbz/evidence/reference-crawler-01shcrxv/crawl.exit
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
start=2026-10-30T19:41:15Z end=2026-10-30T19:43:47Z exit=1
2 changes: 2 additions & 0 deletions cbz/evidence/reference-crawler-01shcrxv/crawl.stdout
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
reference crawl: 28123 references, 9 repositories, 1 blocking; counts {'FOREIGN_REPOSITORY': 1, 'FROZEN_CHANGED': 2435, 'FROZEN_REMOVED': 4322, 'JSON_WITH_COMMENTS': 1, 'LIVE_DRIFT': 1, 'PIN_SKEW': 4}
BLOCKING LIVE_DRIFT main:docs/math_status/STATUS_RN_UNIF.md cited by Math-:frontiers/three_fronts_20260924/SOURCES.json: path absent at 81acc060341e8a31cc4cd4f9523ef71fb6c06175
33 changes: 33 additions & 0 deletions cbz/evidence/reference-crawler-01shcrxv/integration/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
# Integration kit for Root (B-003)

Everything here is a proposal. Nothing in this directory is active until Root moves it into place.

| File | What it is | How to apply it |
|---|---|---|
| `root-695.patch` | Adds the tool's `GOVERNANCE.md` tool-registry entry and its `TOOLING.md` row, in #695's own format | `git apply root-695.patch` at #695 head `82d9e480`; checked with `git apply --check` |
| `cbz-federation-references.yml` | The G7 merge gate. It runs on every pull request, on each push to `main`, nightly and on demand. It crawls the federation with the tested commit as main's candidate (`--repo main=main --at main=HEAD`), in strict mode with the reviewed acknowledgements (`--strict --acknowledged tools/cbz/reference_crawler_acknowledged.json`). Every other repository is cloned anonymously from its `pins.json` URL; all are public. | Copy into `.github/workflows/`. To make it a required context, add `federation-references` to ruleset `23798639`. |
| `cbz-reference-crawler-self-test.yml` | The tool's own G0/G6 evidence, hosted: the tests in both interpreter modes, then the mutation check. Path-filtered to the tool, its tests and the workflow, because the mutation run takes about 35 minutes. | Copy into `.github/workflows/`. |

**Why the gate runs strict.** The owner's addendum requires G7 to block merge synchronization
when it detects drift.
- **Without `--strict`,** interface drift is INFO.
- **With `--strict` alone,** every historical citation whose cited file later changed or was
removed would block forever. A dated report or an archived snapshot cites a file at a commit
on purpose.
- **The acknowledgement file** lists those citing files, each with a reason that can be checked
against the file. The gate then blocks on every other drift.
- **Changes are visible.** A pull request that adds an acknowledgement shows it in its diff, with
its reason.

The evidence README's section "Interface drift under `--strict`" gives the counts and every run.

**What a green gate means.** Once Math-#548 lands, this gate exits 0 on the current federation.
The readback at #548's current head `542cadbc`, and at its earlier head `44a583c4`, gives 0
blocking at the pins and at the tips, in strict mode with the acknowledgements. From then on it
fails any pull request that does any of these:
- records a broken reference;
- breaks a live reference into main;
- changes or removes an interface that an unacknowledged record cites.

**Simulation on this pull request.** The gate's own command is run on each pushed head of #721,
with this repository's checkout as main's mirror. Each result is posted on #721 for its exact head.
Original file line number Diff line number Diff line change
@@ -0,0 +1,50 @@
# Proposed for .github/workflows/ by #721; Root decides whether to bind it (B-003).
# The owner's addendum requires drift to block merge synchronization, so the gate runs --strict:
# interface drift blocks unless tools/cbz/reference_crawler_acknowledged.json records it as a
# reviewed historical citation. A pull request that changes that file shows the change in its diff.
name: CBZ federation references
'on':
pull_request:
push:
branches: [main]
schedule:
- cron: '23 5 * * *'
workflow_dispatch:
permissions:
contents: read
jobs:
crawl:
name: federation-references
runs-on: ubuntu-latest
timeout-minutes: 40
steps:
- uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1
with:
persist-credentials: false
fetch-depth: 0
path: main
- uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97
with:
python-version: '3.11'
- name: Crawl the federation with this head as main's candidate (G7 merge gate)
env:
PYTHONDONTWRITEBYTECODE: '1'
run: |
set -euo pipefail
# Only the workspace is named here. Every other repository is discovered from its pins and
# registries, and cloned (all are public) into the cache. main is this checkout, crawled at
# the tested commit in place of its pin; everything else stays at its pin. The log lists every
# blocking finding.
git clone -q https://github.com/d6g8k5htny-coder/Universal-Law-Workspace.git ulw
mkdir -p fed
head=$(git -C main rev-parse HEAD)
python -B -S main/tools/cbz/reference_crawler.py --workspace ulw --cache fed \
--repo main=main --at "main=$head" \
--strict --acknowledged main/tools/cbz/reference_crawler_acknowledged.json \
--json "$RUNNER_TEMP/references.json" --markdown "$RUNNER_TEMP/references.md"
- if: always()
uses: actions/upload-artifact@cf430e030ddbb5b0abf93d22962f4752f3646cd9
with:
name: federation-references
path: ${{ runner.temp }}/references.*
if-no-files-found: warn
Original file line number Diff line number Diff line change
@@ -0,0 +1,53 @@
# Proposed for .github/workflows/ by #721; Root decides whether to bind it (B-003).
name: CBZ reference crawler self-test
'on':
pull_request:
paths:
- 'tools/cbz/reference_crawler.py'
- 'tools/cbz/reference_crawler_mutation_check.py'
- 'tests/test_cbz_reference_crawler.py'
- 'tests/test_reference_crawler_mutation_check.py'
- '.github/workflows/cbz-reference-crawler-self-test.yml'
push:
branches: [main]
paths:
- 'tools/cbz/reference_crawler.py'
- 'tools/cbz/reference_crawler_mutation_check.py'
- 'tests/test_cbz_reference_crawler.py'
- 'tests/test_reference_crawler_mutation_check.py'
workflow_dispatch:
permissions:
contents: read
jobs:
self-test:
name: reference-crawler-self-test
runs-on: ubuntu-latest
timeout-minutes: 75
steps:
- uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1
with:
persist-credentials: false
- uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97
with:
python-version: '3.11'
- name: Tests in both interpreter modes, then the mutation check (G6, B-011)
env:
PYTHONDONTWRITEBYTECODE: '1'
run: |
set -euo pipefail
for flag in "" "-O"; do
python -B -S $flag -m unittest -v tests.test_cbz_reference_crawler 2>&1 | tee -a "$RUNNER_TEMP/tests.log"
python -B -S $flag -m unittest -v tests.test_reference_crawler_mutation_check 2>&1 | tee -a "$RUNNER_TEMP/grader-tests.log"
done
grep -Ec '^Ran [1-9][0-9]* tests? in ' "$RUNNER_TEMP/tests.log" | grep -qx 2
grep -Ec '^Ran [1-9][0-9]* tests? in ' "$RUNNER_TEMP/grader-tests.log" | grep -qx 2
python -B -S tools/cbz/reference_crawler_mutation_check.py \
--write-failmap "$RUNNER_TEMP/mutant-failmap-v2.json" 2>&1 | tee "$RUNNER_TEMP/mutation.log"
- if: always()
uses: actions/upload-artifact@cf430e030ddbb5b0abf93d22962f4752f3646cd9
with:
name: reference-crawler-self-test
path: |
${{ runner.temp }}/*.log
${{ runner.temp }}/mutant-failmap-v2.json
if-no-files-found: warn
39 changes: 39 additions & 0 deletions cbz/evidence/reference-crawler-01shcrxv/integration/root-695.patch
Original file line number Diff line number Diff line change
@@ -0,0 +1,39 @@
diff --git a/GOVERNANCE.md b/GOVERNANCE.md
index 117b2efd..e1aba31d 100644
--- a/GOVERNANCE.md
+++ b/GOVERNANCE.md
@@ -135,6 +135,22 @@ CBZ-0.
26-head historical regeneration passed. They do not certify mathematics,
independence or actual PR disposition. Obsolete staging text is historical.
Owner none, self-contained; criteria 2,3,10,11,12.
+- **Federation reference crawler (2026-10-30):** `tools/cbz/reference_crawler.py`, with
+ `tests/test_cbz_reference_crawler.py`, `tools/cbz/reference_crawler_mutation_check.py`, the
+ reviewed acknowledgements `tools/cbz/reference_crawler_acknowledged.json` and the evidence README
+ `cbz/evidence/reference-crawler-01shcrxv/README.md`. Discovers the federation from the
+ workspace's pins and registries, with no repository list, and resolves every cross-repository
+ reference record and commit-pinned URL against the named repository's Git objects. It blocks on a
+ broken or mismatched reference and on an incomplete census (unparseable or unread file,
+ incomplete topology, malformed identity, conflicting aliases). Under `--strict`, which G7 uses,
+ interface drift in a cited file also blocks: a changed Lean statement, Python signature or JSON
+ shape, or a removed Lean, Python or JSON file. The exception is a citing file that the
+ acknowledgements record as a reviewed historical citation. `--at NAME=REV` gates a candidate head
+ against the rest of the federation at its pins. A G7 component with `tools/cbz_drift/crawl.py`.
+ Observed: 48 tests per Python mode, and all source mutants killed by their designated tests'
+ assertion failures (B-011), with baseline, syntax-broken and error-only controls. It certifies
+ recorded reference identity only, not mathematics or elaboration. Owner none, self-contained;
+ criteria 8,10,11.
- Existing core compiled auditors, fixture launchers and recovery commands
are catalogued in `TOOLING.md`. A scope-limited or historical success is
never promoted to a federation certificate.
diff --git a/TOOLING.md b/TOOLING.md
index d951ac24..040933d0 100644
--- a/TOOLING.md
+++ b/TOOLING.md
@@ -12,6 +12,7 @@ Checkpoint registry, **not G11 final admission**. Exact final source/run evidenc
| Git bundle/SHA-lease cleanup | `git bundle verify PATH`; guarded atomic ref deletion | Ancestor checks, excluded PR/protected/workflow refs, actual absence readback; no mathematical certification | none;1,2 |
| Bounded proof-closure replay | [Exact tool commands](cbz/evidence/kernel/additional/replay-tool/README.md), [additional package replay](cbz/evidence/kernel/additional/HOW_TO_REPLAY.md), [determinant replay](cbz/evidence/kernel/determinant/HOW_TO_REPLAY.md) | 31 tests/three Python mutants per mode; actual Lean positive/six adverse/six auditor mutants in both modes. Official empty trust-zero kernel; supplied text does not authenticate execution | none;3,6,9,11 |
| PR/citation evidence | [Exact ordinary/optimized test and mutation commands](cbz/evidence/stale-pr-dispositions/README.md) | 35+9 tests and49 intended source/harness kills per mode. Actual network fetch and26-head historical regeneration. Advisory recorded facts, no current approval or mathematical certification | none;2,3,10,11,12 |
+| Main tools/cbz/reference_crawler.py | `python3 -B -S tools/cbz/reference_crawler.py --workspace ULW --cache DIR [--at main=HEAD] --strict --acknowledged tools/cbz/reference_crawler_acknowledged.json --json OUT`. Resolves every cross-repository reference record and commit-pinned URL; exit 1 on a broken reference, unacknowledged interface drift or an incomplete census | 48 tests per mode; every source mutant killed by its designated test's assertion (B-011), with baseline, syntax and error-only controls (`reference_crawler_mutation_check.py`). Live, strict with the 21 acknowledgements: 1 blocking at the pins and at current tips (Math- `rn_status`), 0 with Math-#548. Git-object and text identity only; no elaboration or mathematical certification | none, self-contained; 8 (G7), 10, 11 |

New census self-tests:

Loading
Loading