Repository navigation
v0.5.44 — Recalibration report with schema validation (Loop 23) - #142
Merged
Merged
Conversation
Add standalone recalibration report module + JSON Schema: - schemas/recalibration_report.schema.json: Draft 2020-12 schema enforcing report_type, schema_version, human_review_required=True, gate_verdict (may_recalibrate, cohort counts, rule_results, prohibited_action_audit, rate_limit_status, summary), proposal (gate_passed, L1 totals, deltas with scorer/current/proposed/delta/rationale) - reports/recalibration_report.py: build_recalibration_report(), write_recalibration_report_json(), write_recalibration_report_markdown(), validate_recalibration_report() - CLI uses combined report for --out-json and --out-md output (includes gate verdict context alongside weight deltas) - Dry-run diff now shows gate summary (rule count, prohibited actions) - 9 new tests: shape, gate context, proposal, delta fields, schema validation (valid + missing + human_review_required enforcement), JSON write+validate round-trip, markdown sections - 1813 total tests passing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Loop 23 — Human-readable recalibration report
Bottleneck
No weight-change report that a human reviewer can inspect with gate-verdict context.
Changes
schemas/recalibration_report.schema.json(Draft 2020-12)reports/recalibration_report.py:build_recalibration_report(),write_recalibration_report_json(),write_recalibration_report_markdown(),validate_recalibration_report()--out-jsonand--out-md(proposal + gate verdict)Verification
Next
Loop 24 — Second-batch selection logic (
active_learning/selector.py)