diff --git a/docs/research/NEXT_100_PR_MAP.md b/docs/research/NEXT_100_PR_MAP.md index e0e15292..4eb08ef4 100644 --- a/docs/research/NEXT_100_PR_MAP.md +++ b/docs/research/NEXT_100_PR_MAP.md @@ -233,5 +233,5 @@ Make it possible for an external reviewer to understand, in one artifact, why sp | S1 | Add score vs cheap-enemy gap report schema (SEG-) (complete). — src/openamp_foundry/evidence/score_enemy_gap_report.py: SEG- 16-field schema + CheapEnemyResult helper; VALID_GAP_VERDICTS (4: gap_meaningful/gap_marginal/gap_absent/comparison_not_run), VALID_CHEAP_ENEMY_TYPES (8), VALID_GAP_ASSESSMENT_METHODS (5); MINIMUM_MEANINGFUL_GAP=0.05; build() auto-computes verdict+best_enemy+gap; dry_lab_only=True enforced; 53 tests. BASELINE: 9215→9278. PR #966. | Flags when pipeline score margin over best cheap baseline is below a meaningful threshold; prevents advancing candidates that cheap baselines explain equally well. | C | | S2 | Add selection transparency ledger schema (STL-) (complete). — src/openamp_foundry/evidence/selection_transparency_ledger.py: STL- 16-field schema + ArtifactReference helper; VALID_SELECTION_BASES (8), VALID_SELECTION_OUTCOME_TYPES (7), VALID_LEDGER_COMPLETENESS_GRADES (4); REQUIRED (BSP/SEG/SRG); not_specified blocked; complete grade requires all required; build() auto-computes completeness; dry_lab_only=True; 48 tests. BASELINE: 9278→9341. PR #968. | Per-candidate-family ledger of every evidence artifact that influenced selection; makes selection_basis auditable and traceable. | C | | S3 | Add evidence completeness checker schema (ECC-) (complete). — src/openamp_foundry/evidence/evidence_completeness_checker.py: ECC- 17-field schema + ArtifactPresenceRecord helper; EXPECTED_ARTIFACT_TYPES (10: BSP/WHR/PCU/HCR/PQG/CFC/FNR/ATR/SRG/PEB), VALID_COMPLETENESS_GRADES (5: A-D/N/A); grade A=all present→ready_for_review; grade B=all dry+≥2 wet→ready_for_review; grade C=all dry,wet incomplete→dry_lab_review_only; grade D=dry missing→not_ready; build() auto-computes from present_artifact_ids dict; dry_lab_only=True; 63 tests. BASELINE: 9341→9404. PR #971. | Lists all expected artifact types (BSP/WHR/PCU/HCR/PQG/CFC/FNR/ATR/SRG/PEB) and which are present/absent for a candidate family; completeness_grade (A–D); closes "what's still needed for review?" question. | C | -| S4 | Add pipeline run stability report schema (RSR-). | Compares outputs across N pipeline runs; flags candidate families whose ranking is unstable across runs; prevents overconfident selection of borderline candidates. | C | +| S4 | Add pipeline run stability report schema (RSR-) (complete). — src/openamp_foundry/evidence/pipeline_run_stability_report.py: RSR- schema; PipelineRunStabilityReport (18 fields) + RunRankRecord helper; VALID_STABILITY_VERDICTS (4: stable/borderline/unstable/single_run), VALID_COMPARISON_METHODS (5); DEFAULT_STABILITY_THRESHOLD=2.0; stable=rank_std