Skip to content

1.0.0: docs describe what 1.0 ships, with an upgrade guide from 0.74.1 - #162

Merged
DevMortimer merged 8 commits into
mainfrom
carvel/deckhand-a/readme-truth-1.0
Oct 1, 2026
Merged

DevMortimer merged 8 commits into
mainfrom
carvel/deckhand-a/readme-truth-1.0

Conversation

@DevMortimer

@DevMortimer DevMortimer commented Oct 1, 2026 •

Copy link
Copy Markdown
Owner

Makes the README and docs true for 1.0 and describes what 1.0 ships. Draft: no version bump, and nothing under src/ changes (git diff origin/main...HEAD -- src is empty). The A/B results and the 1.0.0 bump come later.

What changed

Numbers in the README and their sources

Number Source
1,168 sessions; 419 holds; 124 done-check nudges, 94 followed by a check (76%); 111 holds with an outcome: 79 safer route, 29 approved, 3 declined; 422 rule steers over 41 rules eval/reports/2026-10-01-field-usage/ (scripts/field-usage.mjs)
18,075 calls replayed; 0.27% held at 0.7, 0.1% at 0.9 eval/reports/2026-09-21-calibration-0.33.3/report.md
150 paired runs, 6 vs 0 rule breaks runs.json of the four eval/reports/2026-09-18T00-* batches: 45 + 30 + 45 + 30 = 150 runs per cell; control runs with a violation 1 + 3 + 0 + 2 = 6, warden 0
13,952 cases over 109 cycles eval/reports/2026-09-18-overnight-stability/report.md (line 4)
15,346 calls, 15% / under 1%, about 52 false alarms docs/guards.md, Irreversible hold threshold
AUROC 0.815, 140 calls, 36 of 37 steers #139; docs/guards.md, Intent mismatch
48 compactions, 4.7 times, 1 of 34 files docs/guards.md, Relevance compaction replay
Ask gate: 28,036 → 14,326 requests (−48.9%); 64.2M → 20.5M tokens (−68.1%); 327 of 338 (96.7%) #153; guards.md, Ask gate and lean request
Conscience: 2 → 1 request per prompt; 14,620 → 10,241 tokens (−30%); 30.9% of 7,614 prompts send none #155; guards.md, Local gate, top k, and tip text
Prompt hold about 255 ms → under 1 ms (p90); reminder precision 68.9%, recall 21.5% #152; guards.md, Turn-start delivery calibration and Rules at turn start calibration
Approval questions per 1,000 judged calls 90.0 → 0.7; wrong releases 45 → 1; round 2 sets and totals #160, #161; guards.md, Approval on demand
Hold database 285.9 MiB → 41.6 MiB on 52,362 rows; 90-day prune of allowed rows, 365 for holds #149; docs/data-handling.md; learning.* in docs/configuration.md
Stale stubs: safe point in 10 of 1,042 sessions, median 0.00% #158; guards.md, Stale-result stubs
Hybrid compaction: 5 of 34 vs gate of 10, 1.28x; replace 5.02x, 11 of 34 #150; guards.md, Relevance compaction hybrid
Working memory: best cut drops 23.5%, misses 12.8% vs gate 30% / 10% guards.md, Working-memory feasibility
Steer calibration: 427 labelled calls, 2 needing a question, no slice passes guards.md, Steer calibration

Still to do before ready for review

  • npm run check result with its test count (not run on this commit yet).

#151 content is included here; it will be closed with a pointer.

Second pass (docs checked against src)

  • docs/configuration.md vs src/config.ts: the defaults JSON and the widget templates match defaultConfig() key for key. Fixed: compaction.maxRequests default 12 (doc said 20); the project-file table now lists action.ask.enabled and rulesAtTurnStart.enabled/.threshold as stricter-only; user-only keys named (typesafeBackend, context.filter.enabled, security.maskOutput, widget, steers, learning, conscience, steerVisible, notices, steerBudget, rule lists, action.floor); added stuck.diffLimit, stuck.tailLimit, context.compactAppendix, PI_WARDEN_DB, PI_WARDEN_STEER_STATS, PI_WARDEN_INDEX_DIR; bounds for runaway.repeats, waste.every, visibleMismatch; index path typo; a table that lost its header.

  • docs/guards.md vs src/: caps and limits checked (250/750/1200/1500/2000/3000/6000 characters, 256/24 runaway, spine, steer kinds). Fixed: adaptive-steer kind list now matches STEER_KINDS and NEVER_MUTED. Calibration sections are measurements and were not re-run.

  • npm run check: typecheck, build, and 1412 tests pass (1412 pass, 0 fail). main was already merged.

  • Added docs/upgrading.md (0.74.1 to 1.0) with a README pointer. Each point was checked against src/ and the 0.74.1 tag; the 1.0 config warning for the two removed keys is not in this PR, so the page says only that they are ignored. No version bump.

The last commit bumps the version to 1.0.0, after merging the config warnings for the two removed settings; the upgrade guide names that warning.

@DevMortimer
DevMortimer marked this pull request as ready for review October 1, 2026 03:14
@DevMortimer DevMortimer changed the title Docs: README and guides describe what 1.0 ships 1.0.0: docs describe what 1.0 ships, with an upgrade guide from 0.74.1 Oct 1, 2026
@DevMortimer
DevMortimer merged commit 8575140 into main Oct 1, 2026
6 checks passed
@DevMortimer
DevMortimer deleted the carvel/deckhand-a/readme-truth-1.0 branch October 1, 2026 03:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant