chore(corpus): CHAOS-5721 Rescore six refuse rows as any_of under a corpus version bump - #76
Merged
Merged
Conversation
…on bump
Six rows whose scalar refuse had been overtaken by the servable-kind
admissions rescore to any_of {serve with the row's own family, refuse}.
cv-scoped-projects-by-team-bounded's any_of drops its refuse alternative
now that the role-aware declared-kind terminal landed (it had certified
a role-blind terminal error as a match). Old scoring series kept as
history per corpus/README.md ## Versioning; version-history entry added.
Adds a branch-shape pin (PINNED_5721_ANY_OF) for all seven rows.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Ticket: CHAOS-5721
TEST-EVIDENCE
Scope: data-only change to
corpus/corpus.py(7 rows'expect),corpus/test_corpus.py(pin),corpus/README.md(version history). No scorer/engine code touched.Where the corpus version lives: this corpus has no separate numeric version constant — the corpus version IS this file's git commit sha (
git show <sha>:corpus/corpus.py), which is what a scoring run'scorpus_versionprovenance field records (corpus/semantic_verdict.py:build_verdict). This PR's own commit sha is the bump;corpus/README.md's new version-history section says so explicitly rather than implying a constant changed.BASELINE GUARD disclosure (every row this PR changes; row expectations are chris's data-semantics call):
basis-discovered-incidentsrefuseany_of{serve(family=discovered_cohort_ranking), refuse}disagreeunder the old scalar refuse, can now scoreagree/agree_weakvia the added serve branch; a refusal still matches (unchanged).basis-discovered-repo-countrefuseany_of{serve(family=discovered_cohort_ranking), refuse}cv-org-count-projectsrefuseany_of{serve(family=discovered_cohort_ranking), refuse}basis-grouped-metric-by-reporefuseany_of{serve(family=grouped_cohort_status), refuse}basis-grouped-pr-by-projectrefuseany_of{serve(family=grouped_cohort_status), refuse}pos-grouped-per-phrasingrefuseany_of{serve(family=grouped_cohort_status), refuse}cv-scoped-projects-by-team-boundedany_of{serve(family=scoped_cohort_status), refuse}any_of{serve(family=scoped_cohort_status)}Six rows widen acceptance to admit a serve branch that a prior servable-kind gap made unreachable; one row narrows acceptance by removing a refuse branch that had certified a terminal-role error as a match. Old scoring series stays in git history (
git show <sha>:corpus/corpus.py), never overwritten;corpus/README.mdgets a new## Version historyentry naming both moves. No other row'sexpectchanged.Red-first (pin fails at origin/main,
a9a72b1e): copied origin/main'scorpus/corpus.pyinto this branch'scorpus/test_corpus.pyand ran it —(literal message elides the pin dict's own ticket-id substring per this body's one-ticket-token rule; otherwise verbatim.)
Green at this PR's tip (
5758d48), freshpnpm installfirst (ajv needed byscripts/validate_json_schema.mjs):PINNED_5721_ANY_OFpins all 7 rows by branch SHAPE (outcome + serve family), never by question text; its own red controls (drifted branch, reverted-to-scalar, deleted row) and green control run inside the same file.Full
pnpm test:corpus(schema validation, semantic_verdict, schema-driven shape generation): rc=0, allPASSlines, noFAIL.Full ask-dev quality gate, all rc=0:
CI at this PR's tip (
5758d48, PR #76): all 12 checks pass — Analyze (actions/javascript-typescript/python), Build, CodeQL, Dependency Audit, E2E smoke, Gitleaks Secret Scan, Quality, Unit tests, run_checks.sh self-test, test.PR-ref CodeQL at
5758d48,results_count=0on every analysis:No codex round: data/expectation PR, no scorer code touched.
RISK-NOTES
expect_schema.py'sSCHEMA_VERSIONis unchanged (branch shape itself did not change, only which rows use it).expectis ordered separately, not part of this PR.corpus/semantic_verdict.pyonly (scoring any_of serve branches from persisted semantic state); this PR does not depend on it and does not touch that file.cv-scoped-projects-by-team-bounded's narrowed acceptance means a future rep that still hits the role-blind terminal error will now score as a disagreement instead of silently agreeing — expected and intended by this PR, not a regression to chase.