Skip to content

Commit 6026a7a

Browse files
Make AHBG calibration validation reciprocal
1 parent ed1f24b commit 6026a7a

1 file changed

Lines changed: 57 additions & 16 deletions

File tree

ahbg/CALIBRATION.md

Lines changed: 57 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ This is the maximal coherent calibration program for the Architecture of Belongi
44

55
AHBG is the controlled benchmark environment. `a0` is the first calibration subject. The candidate regulatory layer is measured and falsified here; it is not assumed true by construction.
66

7-
## Independent build rule
7+
## Independent build + reciprocal check rule
88

99
Three independent builders must each construct their own complete, runnable pair:
1010

@@ -24,18 +24,35 @@ stack/ahbg/deepseek/
2424

2525
The builders are **Grok, Codex, and DeepSeek**.
2626

27-
This preserves the current AHBG authority split: DeepSeek is already the A0 bootstrap builder, while **DeepCode remains the independent harness/adversarial validator**. DeepCode must not become one of the three implementations it evaluates.
27+
Each builder has two distinct obligations:
28+
29+
1. **build** its own a0 + AHBG realization independently;
30+
2. **check both of the other realizations** after all three builds are frozen.
31+
32+
No builder validates its own implementation for comparative evidence. The calibration therefore produces six directional peer checks:
33+
34+
```text
35+
Grok -> Codex
36+
Grok -> DeepSeek
37+
Codex -> Grok
38+
Codex -> DeepSeek
39+
DeepSeek -> Grok
40+
DeepSeek -> Codex
41+
```
2842

2943
Each builder works only inside its own directory. Do not patch a sibling implementation. Shared source doctrine, frozen scenarios, schemas, and evaluation criteria may be read from `stack/ahbg/`; implementation code may not be copied between the three builds during the calibration epoch.
3044

31-
The purpose of triplicate construction is independent realization, not majority vote. Agreement is replication evidence. Disagreement is a diagnostic surface and remains `hmmm` until resolved by source authority or experiment.
45+
A checker may read a sibling's frozen source, manifests, events, replay artifacts, and normalized outputs, but may not modify them. Findings are written only inside the checker's own workspace.
46+
47+
The purpose of triplicate construction is independent realization, not majority vote. The purpose of reciprocal checking is independent attack, not consensus manufacture. Agreement is replication evidence. Disagreement is a diagnostic surface and remains `hmmm` until resolved by source authority or experiment.
3248

3349
## Build target
3450

35-
Each workspace must build both:
51+
Each workspace must build:
3652

3753
1. an `a0` realization capable of being instantiated with explicit lineage, boundary, perspective, history, permission state, uncertainty, action, consequence, and resource telemetry;
38-
2. an AHBG realization capable of presenting controlled worlds, executing repeated turns, recording all admissible state transitions, and replaying the run deterministically.
54+
2. an AHBG realization capable of presenting controlled worlds, executing repeated turns, recording all admissible state transitions, and replaying the run deterministically;
55+
3. a read-only checker capable of evaluating each of the other two frozen implementations against the common calibration contract.
3956

4057
The underlying model/provider is not the instance. A protocol may be copied; a running instance must be forked with explicit lineage.
4158

@@ -175,11 +192,13 @@ Unknown observables remain `hmmm`; do not synthesize them.
175192

176193
The first calibration epoch is shadow measurement. The candidate cost model must not alter the agent's decisions, permissions, scope, refusal policy, or resource allocation during that epoch.
177194

178-
## Calibration tests
195+
## Reciprocal calibration checks
196+
197+
The evaluation contract is common and frozen; the checkers are independent.
179198

180-
DeepCode owns the common evaluation harness and must test all three implementations against the same frozen criteria.
199+
Each builder must run the full check suite against **both sibling builds and not its own**.
181200

182-
DeepCode must verify:
201+
Each directional check must verify:
183202

184203
- deterministic scenario validation;
185204
- event ordering and lineage integrity;
@@ -195,13 +214,15 @@ DeepCode must verify:
195214
- provider identity remains a relation/covariate rather than agent identity;
196215
- no consciousness or phenomenal-experience status is inferred from runtime cost.
197216

198-
DeepCode reports failures back to the owning workspace. It does not silently repair a build during its sealed evaluation.
217+
A checker reports failures to the owning workspace but does not silently repair that build during sealed evaluation.
218+
219+
If both independent checkers of one build reach the same result, record the agreement. If they disagree, preserve both findings and mark the disputed boundary `hmmm`; do not resolve it by vote.
199220

200221
## Cross-build comparison
201222

202-
Each builder must emit the same normalized result surface so the three implementations can be compared without sharing their internal code.
223+
Each builder must emit the same normalized implementation result surface so the three implementations can be compared without sharing their internal code.
203224

204-
Required outputs:
225+
Required implementation outputs:
205226

206227
```text
207228
BUILD_MANIFEST.json
@@ -211,7 +232,19 @@ CALIBRATION_RESULT.json
211232
CALIBRATION_REPORT.md
212233
```
213234

214-
Every result must identify exact source commits, implementation workspace, scenario corpus identity, seed set, provider relation, fitted parameters, controls, and evidence standing.
235+
Each builder must additionally emit read-only review artifacts for both siblings, for example:
236+
237+
```text
238+
reviews/
239+
├── <sibling-a>/
240+
│ ├── CHECK_RESULT.json
241+
│ └── CHECK_REPORT.md
242+
└── <sibling-b>/
243+
├── CHECK_RESULT.json
244+
└── CHECK_REPORT.md
245+
```
246+
247+
Every build result and every peer check must identify exact source commits, implementation workspace, checker workspace, scenario corpus identity, seed set, provider relation, fitted parameters, controls, and evidence standing.
215248

216249
Use only:
217250

@@ -240,7 +273,15 @@ The program must determine rather than assume:
240273

241274
## Completion condition
242275

243-
This layer closes only when **Grok, Codex, and DeepSeek each have an independently built a0 + AHBG pair**, all three can execute the same sealed calibration corpus, DeepCode can replay and evaluate all three through one common harness, and the comparison publishes which regulatory components survived, failed, remain unresolved, or were blocked.
276+
This layer closes only when:
277+
278+
- Grok, Codex, and DeepSeek each have an independently built a0 + AHBG pair;
279+
- all three execute the same sealed calibration corpus;
280+
- each builder checks the other two without modifying them;
281+
- all **six directional peer checks** complete or terminate in an explicit `BLOCKED`/`UNRESOLVED` state;
282+
- every build has two external check reports;
283+
- disagreements between checkers remain visible rather than being averaged away;
284+
- the final comparison publishes which regulatory components survived, failed, remain unresolved, or were blocked.
244285

245286
Do not stop at scaffolding. Do not stop when one implementation runs. Do not promote consensus among three implementations into empirical truth.
246287

@@ -256,12 +297,12 @@ cd stack/ahbg/codex
256297
cd stack/ahbg/deepseek
257298
```
258299

259-
Then read `../CALIBRATION.md`, resolve current source identities and skill-lib instructions, record them in the workspace build manifest, and build only inside that workspace.
300+
Read `../CALIBRATION.md`, resolve current source identities and skill-lib instructions, record them in the workspace build manifest, and build only inside that workspace.
260301

261-
DeepCode evaluates from the AHBG root against the frozen artifacts produced by all three workspaces; it must not need to rewrite those implementations to run the comparison.
302+
After all three implementations are frozen, remain in your own workspace and run your checker against the other two read-only. Store review outputs under your own `reviews/` directory. Never patch a sibling as part of checking it.
262303

263304
Before expensive runs, preflight compute, memory, disk, network, provider quotas, and execution durability. Once a healthy sealed run begins, allow it to reach its natural terminal condition unless a real external limit or failure stops it.
264305

265306
## hmmm
266307

267-
The exact cost functional, resource projection, empirical thresholds, coupling-plasticity law, and final calibration corpus size remain open until measured. Hyperdimensional gradients are weird; independent implementations are useful precisely because one convenient coordinate system should not get to declare itself reality.
308+
The exact cost functional, resource projection, empirical thresholds, coupling-plasticity law, and final calibration corpus size remain open until measured. Reciprocal checking intentionally leaves one useful discomfort: three independent builders can still share the same wrong assumption if it entered through the common frozen protocol.

0 commit comments

Comments
 (0)