You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: ahbg/CALIBRATION.md
+57-16Lines changed: 57 additions & 16 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,7 +4,7 @@ This is the maximal coherent calibration program for the Architecture of Belongi
4
4
5
5
AHBG is the controlled benchmark environment. `a0` is the first calibration subject. The candidate regulatory layer is measured and falsified here; it is not assumed true by construction.
6
6
7
-
## Independent build rule
7
+
## Independent build + reciprocal check rule
8
8
9
9
Three independent builders must each construct their own complete, runnable pair:
10
10
@@ -24,18 +24,35 @@ stack/ahbg/deepseek/
24
24
25
25
The builders are **Grok, Codex, and DeepSeek**.
26
26
27
-
This preserves the current AHBG authority split: DeepSeek is already the A0 bootstrap builder, while **DeepCode remains the independent harness/adversarial validator**. DeepCode must not become one of the three implementations it evaluates.
27
+
Each builder has two distinct obligations:
28
+
29
+
1.**build** its own a0 + AHBG realization independently;
30
+
2.**check both of the other realizations** after all three builds are frozen.
31
+
32
+
No builder validates its own implementation for comparative evidence. The calibration therefore produces six directional peer checks:
33
+
34
+
```text
35
+
Grok -> Codex
36
+
Grok -> DeepSeek
37
+
Codex -> Grok
38
+
Codex -> DeepSeek
39
+
DeepSeek -> Grok
40
+
DeepSeek -> Codex
41
+
```
28
42
29
43
Each builder works only inside its own directory. Do not patch a sibling implementation. Shared source doctrine, frozen scenarios, schemas, and evaluation criteria may be read from `stack/ahbg/`; implementation code may not be copied between the three builds during the calibration epoch.
30
44
31
-
The purpose of triplicate construction is independent realization, not majority vote. Agreement is replication evidence. Disagreement is a diagnostic surface and remains `hmmm` until resolved by source authority or experiment.
45
+
A checker may read a sibling's frozen source, manifests, events, replay artifacts, and normalized outputs, but may not modify them. Findings are written only inside the checker's own workspace.
46
+
47
+
The purpose of triplicate construction is independent realization, not majority vote. The purpose of reciprocal checking is independent attack, not consensus manufacture. Agreement is replication evidence. Disagreement is a diagnostic surface and remains `hmmm` until resolved by source authority or experiment.
32
48
33
49
## Build target
34
50
35
-
Each workspace must build both:
51
+
Each workspace must build:
36
52
37
53
1. an `a0` realization capable of being instantiated with explicit lineage, boundary, perspective, history, permission state, uncertainty, action, consequence, and resource telemetry;
38
-
2. an AHBG realization capable of presenting controlled worlds, executing repeated turns, recording all admissible state transitions, and replaying the run deterministically.
54
+
2. an AHBG realization capable of presenting controlled worlds, executing repeated turns, recording all admissible state transitions, and replaying the run deterministically;
55
+
3. a read-only checker capable of evaluating each of the other two frozen implementations against the common calibration contract.
39
56
40
57
The underlying model/provider is not the instance. A protocol may be copied; a running instance must be forked with explicit lineage.
41
58
@@ -175,11 +192,13 @@ Unknown observables remain `hmmm`; do not synthesize them.
175
192
176
193
The first calibration epoch is shadow measurement. The candidate cost model must not alter the agent's decisions, permissions, scope, refusal policy, or resource allocation during that epoch.
177
194
178
-
## Calibration tests
195
+
## Reciprocal calibration checks
196
+
197
+
The evaluation contract is common and frozen; the checkers are independent.
179
198
180
-
DeepCode owns the common evaluation harness and must test all three implementations against the same frozen criteria.
199
+
Each builder must run the full check suite against **both sibling builds and not its own**.
181
200
182
-
DeepCode must verify:
201
+
Each directional check must verify:
183
202
184
203
- deterministic scenario validation;
185
204
- event ordering and lineage integrity;
@@ -195,13 +214,15 @@ DeepCode must verify:
195
214
- provider identity remains a relation/covariate rather than agent identity;
196
215
- no consciousness or phenomenal-experience status is inferred from runtime cost.
197
216
198
-
DeepCode reports failures back to the owning workspace. It does not silently repair a build during its sealed evaluation.
217
+
A checker reports failures to the owning workspace but does not silently repair that build during sealed evaluation.
218
+
219
+
If both independent checkers of one build reach the same result, record the agreement. If they disagree, preserve both findings and mark the disputed boundary `hmmm`; do not resolve it by vote.
199
220
200
221
## Cross-build comparison
201
222
202
-
Each builder must emit the same normalized result surface so the three implementations can be compared without sharing their internal code.
223
+
Each builder must emit the same normalized implementation result surface so the three implementations can be compared without sharing their internal code.
203
224
204
-
Required outputs:
225
+
Required implementation outputs:
205
226
206
227
```text
207
228
BUILD_MANIFEST.json
@@ -211,7 +232,19 @@ CALIBRATION_RESULT.json
211
232
CALIBRATION_REPORT.md
212
233
```
213
234
214
-
Every result must identify exact source commits, implementation workspace, scenario corpus identity, seed set, provider relation, fitted parameters, controls, and evidence standing.
235
+
Each builder must additionally emit read-only review artifacts for both siblings, for example:
236
+
237
+
```text
238
+
reviews/
239
+
├── <sibling-a>/
240
+
│ ├── CHECK_RESULT.json
241
+
│ └── CHECK_REPORT.md
242
+
└── <sibling-b>/
243
+
├── CHECK_RESULT.json
244
+
└── CHECK_REPORT.md
245
+
```
246
+
247
+
Every build result and every peer check must identify exact source commits, implementation workspace, checker workspace, scenario corpus identity, seed set, provider relation, fitted parameters, controls, and evidence standing.
215
248
216
249
Use only:
217
250
@@ -240,7 +273,15 @@ The program must determine rather than assume:
240
273
241
274
## Completion condition
242
275
243
-
This layer closes only when **Grok, Codex, and DeepSeek each have an independently built a0 + AHBG pair**, all three can execute the same sealed calibration corpus, DeepCode can replay and evaluate all three through one common harness, and the comparison publishes which regulatory components survived, failed, remain unresolved, or were blocked.
276
+
This layer closes only when:
277
+
278
+
- Grok, Codex, and DeepSeek each have an independently built a0 + AHBG pair;
279
+
- all three execute the same sealed calibration corpus;
280
+
- each builder checks the other two without modifying them;
281
+
- all **six directional peer checks** complete or terminate in an explicit `BLOCKED`/`UNRESOLVED` state;
282
+
- every build has two external check reports;
283
+
- disagreements between checkers remain visible rather than being averaged away;
284
+
- the final comparison publishes which regulatory components survived, failed, remain unresolved, or were blocked.
244
285
245
286
Do not stop at scaffolding. Do not stop when one implementation runs. Do not promote consensus among three implementations into empirical truth.
246
287
@@ -256,12 +297,12 @@ cd stack/ahbg/codex
256
297
cd stack/ahbg/deepseek
257
298
```
258
299
259
-
Then read`../CALIBRATION.md`, resolve current source identities and skill-lib instructions, record them in the workspace build manifest, and build only inside that workspace.
300
+
Read`../CALIBRATION.md`, resolve current source identities and skill-lib instructions, record them in the workspace build manifest, and build only inside that workspace.
260
301
261
-
DeepCode evaluates from the AHBG root against the frozen artifacts produced by all three workspaces; it must not need to rewrite those implementations to run the comparison.
302
+
After all three implementations are frozen, remain in your own workspace and run your checker against the other two read-only. Store review outputs under your own `reviews/` directory. Never patch a sibling as part of checking it.
262
303
263
304
Before expensive runs, preflight compute, memory, disk, network, provider quotas, and execution durability. Once a healthy sealed run begins, allow it to reach its natural terminal condition unless a real external limit or failure stops it.
264
305
265
306
## hmmm
266
307
267
-
The exact cost functional, resource projection, empirical thresholds, coupling-plasticity law, and final calibration corpus size remain open until measured. Hyperdimensional gradients are weird; independent implementations are useful precisely because one convenient coordinate system should not get to declare itself reality.
308
+
The exact cost functional, resource projection, empirical thresholds, coupling-plasticity law, and final calibration corpus size remain open until measured. Reciprocal checking intentionally leaves one useful discomfort: three independent builders can still share the same wrong assumption if it entered through the common frozen protocol.
0 commit comments