Repository navigation
kolibri1 TT b2ii: ratify and report the band gate as the P150 standard - #3483
Merged
Merged
Conversation
The developer ratified (2026-10-19) the band gate as the P150 correctness standard for the B2b-ii device token gate: a sequence is ON iff it has ZERO hard flips — divergences inside the established 2.5-nat near-tie band are not gate failures; the exact-token ON/OFF counting is no longer the bar; the primary oracle rows (the W3 141/145 CPU baseline) remain the denominator. The scorer now prints the band-gate verdict line (BAND GATE: X/Y sequences ON, with the worst in-band divergence against the 2.5-nat band edge) beside the unchanged exact-token reporting. A reporting change, not a tolerance change: the classifier (the per-position nat gap vs the golden chain, -gap <= kNatBand, tests/vllm/models/ test_kolibri1_tt_b2ii.cpp:1222) is untouched. THREE-RUN VERDICT on origin/main 61d333e, P150 non-fleet under the device recipe, byte-identical flip sets across all three runs per arm: - HOST-FREE ON: BAND GATE 3/8 sequences ON, worst in-band -1.747 nats (margin 0.753); exact-token 3/11 (3 near-ties, 5 hard). - HOST-FREE OFF: BAND GATE 6/8 sequences ON, worst in-band -2.157 nats (margin 0.343); exact-token 12/20 (6 near-ties, 2 hard). No classifier defect: no flip beyond the band is recorded as a near-tie on either arm. The verdict is stable and now a measured, dated quantity. The three pre-existing assertion failures remain documented: :1263 (argmax_matches >= 141), :1264 (hard_flips == 0), :1419 (instr_hard_flips == 0); they still fire and the hard-flip sequences stay owed. Records: the 2026-10-19 entry on ISSUE-LOCAL-01M4P21TZ1Q9CA7P66XBH0BQTX and the row spec's `.agents/specs/kolibri-tt.md` `## Now`. Gates: the b2ii device gate 3x stable per arm; host kolibri1 suite 18/21 (test_kolibri1_dequant_cache, test_kolibri1_w3, test_kolibri1_ngram_spec fail identically on pristine origin/main — pre-existing on this host); scripts/check-agent-record.py OK; preflight --staged green except check-windows-portability.py, which fails identically on pristine origin/main (pre-existing, environment). This change follows .agents/AGENTS.md — an open canonical local issue owns the work, the record edits ride the change that made them true, the gate evidence above is dated, and the independent fresh review passed before merge. FOLLOWING_AGENTS_PROTOCOL Following-Agents-Protocol: true AI-Assisted: true Assisted-by: AGENT:zai/glm-5.3-flash [maki]
lu-zero
force-pushed
the
row/TT-B2II-BAND-GATE
branch
from
October 19, 2026 20:51
b81046d to
7a4d712
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
kolibri1 TT b2ii: ratify and report the band gate as the P150 standard
The ratified standard
The developer ratified (2026-10-19) the band gate as the P150
correctness standard for the B2b-ii device token gate: a sequence is ON
iff it has ZERO hard flips — divergences inside the established
2.5-nat near-tie band are not gate failures; the exact-token ON/OFF
counting is no longer the bar; the primary oracle rows (the W3 141/145
CPU baseline) remain the denominator.
The scorer change
test_kolibri1_tt_b2ii.cppnow prints the band-gate verdict line(
BAND GATE (ratified 2026-10-19): X/Y sequences ON, with the worstin-band divergence against the band edge) beside the unchanged
exact-token reporting. A reporting change, not a tolerance change: the
classifier — the per-position nat gap vs the golden greedy chain,
-gap <= kNatBand(band 2.5), tests/vllm/models/test_kolibri1_tt_b2ii.cpp:1222 — is untouched.
Three-run verdict (origin/main 61d333e, P150, device recipe)
Byte-identical flip sets across all three runs per arm; the verdict is
stable, no flapping.
VT_TT_HOST_FREE_DECODE=0)Both exact-token counts reproduce the recorded 3/11 and 12/20 exactly.
No classifier defect: no flip beyond the band is recorded as a near-tie
on either arm (checked programmatically across the flip records).
What becomes gateable
Under the ratified standard the b2ii token gate has a STABLE, dated,
measured ON/OFF verdict (3/8 ON, 6/8 ON) instead of an exact-token
coincidence count. The gate is not yet "all sequences ON": the
hard-flip sequences (ON arm: Australia, Wissen, x1=, Ein gutes,
counting; OFF arm: der Mond, counting) stay owed, and the three
pre-existing assertion failures remain, documented:
:1263(argmax_matches >= 141),
:1264(hard_flips == 0),:1419(instr_hard_flips == 0).
Records
ISSUE-LOCAL-01M4P21TZ1Q9CA7P66XBH0BQTX— the 2026-10-19 ratificationand rescore entry beside the recorded 3/11 / 12/20 numbers.
.agents/specs/kolibri-tt.md## Now— the lifecycle note.Gates
byte-identical flip sets both arms.
test_kolibri1_dequant_cache,test_kolibri1_w3,test_kolibri1_ngram_specfail identically onpristine origin/main (verified on a clean 61d333e build) —
pre-existing on this host.
scripts/check-agent-record.py: OK.scripts/agent-preflight.sh --staged: green exceptcheck-windows-portability.py, which fails identically on pristineorigin/main (pre-existing, environment).
scripts/check-commit-style.pyand the trailer suites: OK.FOLLOWING_AGENTS_PROTOCOL
Following-Agents-Protocol: true
AI-Assisted: true
Assisted-by: AGENT:zai/glm-5.3-flash [maki]