Skip to content

Report review execution state truthfully in user-facing output - #31

Merged
morgaesis merged 1 commit into
mainfrom
honest-output
Jul 10, 2026
Merged

morgaesis merged 1 commit into
mainfrom
honest-output

Conversation

@morgaesis

Copy link
Copy Markdown
Contributor

Clean check summaries now distinguish a completed model review from runs where no model was called (review disabled by config, or an empty diff), error envelopes carry observed wall-clock duration instead of a hardcoded zero, and failed model runs retain accumulated token usage across repair, cascade, and consensus paths. Doctor output labels its forge-token check as presence-only, the README points at the published bench results instead of unbenchmarked per-model recommendations, and the bench docs name their metrics for what they measure (seeded-region hit rate, catalog-priced cost estimates) and drop unsupported calibration and variance claims.

Clean check summaries now distinguish a completed model review from runs
where no model was called (review disabled by config, empty diff). Error
envelopes carry observed wall-clock duration instead of a hardcoded zero,
and failed model runs retain accumulated token usage across repair,
cascade, and consensus paths instead of reporting zero tokens.

Docs now match what the implementation measures: doctor's forge-token
check is labeled presence-only, the README points at the published bench
results instead of unbenchmarked per-model recommendations, and the bench
docs name their metrics seeded-region hit rate and catalog-priced cost
estimates, dropping unsupported severity-calibration and run-variance
claims.
@morgaesis
morgaesis merged commit b973ebb into main Jul 10, 2026
7 checks passed
@morgaesis
morgaesis deleted the honest-output branch July 10, 2026 11:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant