Skip to content

feat: add communication phase regression scoring - #1

Draft
0z5a wants to merge 2 commits into
codex/inference-bulk-supervisorfrom
codex/communication-regression-scoring
Draft

0z5a wants to merge 2 commits into
codex/inference-bulk-supervisorfrom
codex/communication-regression-scoring

Conversation

@0z5a

@0z5a 0z5a commented Sep 4, 2026

Copy link
Copy Markdown
Owner

Draft update — 2026-09-05

Adds strict communication-evidence hard-negative gates: malformed or unbound evidence cannot produce a passing policy score. The later native-import stack passed 397 CPU tests and 138 schema-freshness checks; these are software checks, not independent GPU hardware confirmation. The baseline entrypoint repair is supplied by dependency #2; the old missing-entrypoint note below is historical.

AI assistance: OpenAI Codex. Remains Draft; implementation, CPU/Gloo checks and production GPU validation are separate acceptance gates. No new GPU results were generated during publication.

The original submission description and validation history follow.


Summary

  • add framework-neutral schemas for communication trace, policy, and regression-result artifacts for arbitrary world_size >= 2
  • validate communicator-local rank sequence and completeness, including overlapping communicator groups
  • score GPU-realized phase offsets, pair completion/stretch, rank skew, consumer slack, and outstanding bytes/count without collapsing unrelated workload cells into a global score
  • compare only exact system/path/load cells and map the new evidence into the existing SystemPathLoadCell model
  • keep kernel-observed timing distinct from event-bracket timing

Why this is not duplicate work

I searched open PRs and issues for communication phase regression scoring and collective overlap regression gates. No existing change provides this framework-neutral artifact contract and strict same-cell comparison path.

Validation

  • new CPU tests with logical 2-rank and 4-rank fixtures: 8 passed
  • full repository suite: 349 passed, 1 deselected
  • Ruff passed across src and tests
  • all 136 schemas regenerate without drift
  • one unrelated baseline-only failure remains in tests/test_historical_bulk_gates.py::test_training_campaign_uses_large_groups_after_safe_boundary: upstream main references the untracked file benchmarks/historical_prs/infraswe-inference-bulk-supervisor.sh; this branch does not touch that area
  • this PR makes no hardware performance claim

AI assistance disclosure

This draft was developed with OpenAI Codex assistance. The human submitter must review and understand every changed line before marking it ready for review.

@0z5a
0z5a force-pushed the codex/communication-regression-scoring branch from aaa1e1c to 182ba05 Compare September 4, 2026 15:32
@0z5a
0z5a changed the base branch from main to codex/inference-bulk-supervisor September 4, 2026 15:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant