Skip to content

feat: Phase O O3 calibration improvement record schema -- CIR- before/after audit with metric direction validation - #864

Merged
cschanhniem merged 1 commit into
mainfrom
feat/o3-calibration-improvement-record
Jul 10, 2026
Merged

cschanhniem merged 1 commit into
mainfrom
feat/o3-calibration-improvement-record

Conversation

@cschanhniem

Copy link
Copy Markdown
Collaborator

Summary

  • CalibrationImprovementRecord: 12 fields, before/after audit record for calibration updates
  • 11 validation rules: CIR- prefix, pipeline_version non-empty, calibration_version_before/after non-empty and must differ, ISO date, metric_name vocab (8: auroc/auprc/brier_score/calibration_error/precision_at_k/recall_at_k/f1_at_threshold/expected_calibration_error), improvement_confirmed=True enforced, rationale non-empty and ≤400 chars, data_source_id non-empty, notes ≤300 chars
  • 3 warnings: wrong metric direction (higher-is-better/lower-is-better), very small improvement (<0.005), notes empty
  • 63 tests; BASELINE 5729->5792
  • CLI: openamp-foundry calibration-improvement-record-check
  • Completes Phase O: CIR- joins O1/O2/O4/O5 with the missing before/after change record

…/after audit record with metric direction validation and version diff enforcement
@cschanhniem
cschanhniem merged commit 6c553bf into main Jul 10, 2026
1 check failed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant