Skip to content

feat: Phase H H6 simulation uncertainty calibration report -- SUC- schema tracks whether module confidence intervals are empirically calibrated, overconfidence flag, 63 tests - #924

Merged
cschanhniem merged 1 commit into
mainfrom
feat/h6-simulation-uncertainty-calibration-report
Jul 10, 2026
Merged

cschanhniem merged 1 commit into
mainfrom
feat/h6-simulation-uncertainty-calibration-report

Conversation

@cschanhniem

Copy link
Copy Markdown
Collaborator

Implements H6 from NEXT_100_PR_MAP: simulation uncertainty calibration report.

What

  • src/openamp_foundry/simulation/uncertainty_calibration_report.py: SUC- prefix schema, 14 fields
  • VALID_SIMULATION_MODULES, VALID_CALIBRATION_METHODS, VALID_UNCERTAINTY_ASSESSMENT_STATUSES
  • overconfidence_flag consistency enforcement, calibration_error integrity check
  • tests/simulation/test_uncertainty_calibration_report.py: 63 tests, 5 classes
  • BASELINE: 8221 → 8284

Why

A simulation module that claims 80% confidence intervals should contain the true value 80% of the time. SUC- records make over-confidence auditable.

Disconfirming pass

  • dry_lab_only enforced on all reports
  • insufficient_data required when n_samples < 10

…hema tracks whether module confidence intervals are empirically calibrated, overconfidence flag, 63 tests (#923)
@cschanhniem
cschanhniem merged commit 574bc95 into main Jul 10, 2026
0 of 2 checks passed
cschanhniem added a commit that referenced this pull request Jul 10, 2026
…what you may/must/must-not do, artifact-specific constraints, dry-lab-only preservation requirement (#924) (#925)

Co-authored-by: OpenCode <opencode@example.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant