Skip to content

Cut the model-read ecosystem specifics from mutation-testing, starting with its per-tool tables #16752

Open
3 of 3 issues completed

Description

@kyle-sexton

Parent

Refs #15703
Source: #15730 (blind classification under rules revision 5, #15730 comment 6950077480), cut item 3 of 47 in its filing order.

Depends on

Blocks #15732 (the portability gate widens only after every cut lands).

Outcome

mutation-testing ships no model-read tool, library or command choice outside ADR 0101's named exceptions: the 22 rows below are cut (R11 19, R4 2, R8 1), each R8 row unless its targeted case fails without it.

#15730's filing order names this cut ahead of the rest: "mutation-testing's per-tool tables".

Demo: on main after the merge, each listed row's cited text is gone or replaced by generic text at a routing site, and the pull request body lists every row id with what happened to it.

Row count (bulk-mutation standard): 22 rows. The pull request states this number and lists each row.

Rows to cut

Paths are repository-relative; line numbers are as read at 5b66a7fa and may have moved. Kind is the inventory kind (K2 detection table, K3 bundled value, K4 tool guidance, K5 tool pointer, K7 example).

Row Rule Kind Cited at Fact the classifier matched Notes
F0276 R11 K7 plugins/mutation-testing/skills/setup/templates/config-template.md:65-73 The pytest, vitest and Maven forms illustrate the neutral {tests} rule as model-read K7 examples. Two readings (other: R6). Reader's note: F0276: the dotnet test sentence describes the K1-backed script behavior (R6); the rest is illustrative.
F0277 R11 K2 plugins/mutation-testing/skills/setup/SKILL.md:67-70 The probe-1 manifest list is a model-read K2 detection table. The setup description names no ecosystem.
F0278 R11 K2 plugins/mutation-testing/skills/principles/reference/tooling.md:59-72 The "Selecting a tool" manifest list in tooling.md is a model-read K2 detection table that duplicates setup probe 1.
F0279 R11 K4 plugins/mutation-testing/skills/setup/SKILL.md:74-86 Probes 3-4 give model-read runner guidance (Maven -Dtest, Gradle --tests, dotnet test once per project) that no script implements.
F0280 R4 K3 plugins/mutation-testing/skills/setup/SKILL.md:161-189 Apply step 2 names the mutation tool and its install command from the detected ecosystem, and step 6 proposes a per-runner test-command, so the skill picks a tool for the consumer.
F0281 R8 K4 plugins/mutation-testing/skills/audit/context/tool-test-restriction.md:1-13 The restriction table records probe #9687 of Stryker.NET 5.0.0, which found the filter applies to the coverage run and keeps NoCoverage, something the docs do not state. The audit uses a tool's restriction only where this record reads yes. Two readings (other: R11). Reader's note: F0281: the alternative is R11; only the Stryker.NET row is a probe, and the StrykerJS and mutmut rows are doc reads marked unknown.
F0282 R11 K3 plugins/mutation-testing/skills/audit/context/tool-test-restriction.md:15-29 The per-runner test-command filter forms (vitest, jest, mocha, Maven, Gradle, PHPUnit, pytest, unittest) are model-read K3 forms with tool-doc links, and they pick no tool.
F0287 R11 K7 plugins/mutation-testing/skills/audit/context/config-fallback.md:32-38 The bare dotnet test sentence is a .NET example inside the never-guess-the-command rule, and an example inside a guard is judged by the later rules.
F0288 R11 K5 plugins/mutation-testing/skills/audit/SKILL.md:212-221 The StrykerJS inPlace pointer links one tool's documentation, and no kept script drives StrykerJS.
F0289 R4 K4 plugins/mutation-testing/skills/principles/reference/tooling.md:1-57 The Established tools table maps each ecosystem to the mutation tool setup proposes ("From the ecosystem, name the tool"), so it picks a tool for the consumer. Two readings (other: R11). Reader's note: F0289, F0305: the alternative is R11 (K4 guidance) if R4 is limited to K3-style bundled values.
F0290 R11 K7 plugins/mutation-testing/skills/principles/reference/tooling.md:90-114 Naming Shell, Terraform and SQL, plus the marketplace-root lib/hook-utils.test.sh worked example, illustrates the neutral manual protocol as model-read K7 text.
F0291 R11 K4 plugins/mutation-testing/skills/principles/reference/operators-and-states.md:49-67 PIT's default operator catalog is a model-read K4 page for one tool, which no script reads.
F0292 R11 K7 plugins/mutation-testing/skills/principles/reference/operators-and-states.md:81-84 The SBR note citing lib/hook-utils.test.sh mutation notes is a Bash-flavored model-read example.
F0293 R11 K4 plugins/mutation-testing/skills/principles/reference/metrics.md:45-59 The four-names table maps Stryker, PIT and Infection metric vocabulary as model-read K4 guidance.
F0294 R11 K7 plugins/mutation-testing/skills/principles/reference/metrics.md:95-100 src/pricing.ts in the reporting-shape sample is a TypeScript-flavored K7 example.
F0295 R11 K5 plugins/mutation-testing/skills/principles/reference/scaling-and-suppression.md:23-36 The per-tool diff-scoping pointers (Stryker.NET since, StrykerJS --incremental, Infection, PIT) link single tools' docs, and no kept script drives those tools.
F0296 R11 K7 plugins/mutation-testing/skills/principles/reference/scaling-and-suppression.md:132-136 Stryker's thresholds.break quote illustrates "do not gate on the score" with a one-tool example.
F0297 R11 K7 plugins/mutation-testing/skills/principles/reference/theory.md:46-50 The Python range loop is a language-flavored equivalent-mutant example (K7).
F0298 R11 K7 plugins/mutation-testing/skills/audit/context/suppression.md:145-156 src/pricing.ts in the sample suppression entry is a TypeScript-flavored K7 example.
F0299 R11 K5 plugins/mutation-testing/skills/audit/SKILL.md:430-436 The Hypothesis derandomize and fast-check seed links point at single tools' docs as model-read K5 text.
F0300 R11 K7 plugins/mutation-testing/skills/audit/context/persist-findings.md:120-130 .py, .cs and Makefile illustrate "a root that looks like source" as examples. They are not entries in the guard's allowlist (.gitignore, *.md, directories, OS artifacts).
F0301 R11 K5 plugins/mutation-testing/README.md:59-61, 119-136 The README Sources list links Stryker, Stryker.NET, StrykerJS, PIT and Infection tool docs, which are not cited sources under R9. Two readings (other: R6). Reader's note: F0301: README:61 (dotnet test per project) alone would be R6.

Kept rows, not touched here (count per rule): R6 4, R7 1.

Steps

  • List every item with its rule: the pull request body repeats the table above with each row's outcome (cut, replaced at a routing site, or kept with its reason).
  • Back every R11 call with a search showing whether a script reads the file, for example git grep -n -F '<file name>' -- plugins scripts .github, quoted in the pull request body. A row whose file a script reads is not cut here: report it on Classify the remaining guidance rows blind and count the cuts per plugin #15730.
  • Name the cases that read the cut text: in the pull request body, name for each changed skill the existing eval case whose run reads the cut text, or say that none does. The lane names them; it runs none.
  • Whole page or part: in the pull request body, say for each changed file whether the cut deletes the whole page or part of it.
  • R4 rows: the bundled default goes; the choice is resolved from the consumer through the ecosystem-resolution contract (docs/contracts/ecosystem-resolution/). A shipped default that picks a library goes with this cut.
  • R8 rows: cut each like the other rows and mark it in the pull request body as pending its targeted case; the host session's result (below) decides whether it comes back.
  • Fence ratchet: lower the skill-stack-fences ceiling in .performance/ratchets.json for each of these files whose fences the cut removes: plugins/mutation-testing/skills/principles/reference/theory.md, plugins/mutation-testing/skills/audit/context/suppression.md.
  • References outside the plugin: these files on main name a cut file; update or remove each entry the cut makes stale: plugins/mutation-testing/skills/setup/SKILL.md in .github/scripts/pr-unblock/publish-feedback.test.mjs, scripts/docs-anchor-baseline.txt, scripts/em-dash-purged-paths.txt, scripts/shell-portability-skill-md-baseline.txt, scripts/test_check_code_metrics_skill_prose.py, scripts/validate-plugin-contracts.mjs, scripts/validate-plugin-contracts.test.sh; plugins/mutation-testing/skills/principles/reference/tooling.md in scripts/docs-anchor-baseline.txt; plugins/mutation-testing/skills/audit/context/tool-test-restriction.md in scripts/docs-anchor-baseline.txt; plugins/mutation-testing/skills/audit/SKILL.md in scripts/check-fleet-audit-doc-grammar.sh, scripts/check-fleet-audit-doc-grammar.test.sh, scripts/check-script-contract.test.sh, scripts/check-spoke-plugin-root.test.sh, scripts/docs-anchor-baseline.txt; plugins/mutation-testing/skills/principles/reference/operators-and-states.md in scripts/docs-anchor-baseline.txt; plugins/mutation-testing/skills/principles/reference/metrics.md in scripts/docs-anchor-baseline.txt; plugins/mutation-testing/skills/principles/reference/scaling-and-suppression.md in scripts/docs-anchor-baseline.txt; plugins/mutation-testing/skills/principles/reference/theory.md in .performance/ratchets.json; plugins/mutation-testing/skills/audit/context/suppression.md in .performance/ratchets.json; plugins/mutation-testing/skills/audit/context/persist-findings.md in scripts/spoke-plugin-root-baseline.txt; plugins/mutation-testing/README.md in .github/CODEOWNERS, .github/actions/check-kill-switch/README.md, .github/actions/check-signed-commits/README.md, .github/actions/check-trusted-trigger/README.md, .github/actions/check-trusted-trigger/check-trusted-trigger.test.mjs, .github/actions/check-wip-cap/check-wip-cap.mjs, .github/actions/collect-base-activity/action.yml, .github/actions/collect-base-activity/collect-base-activity.test.mjs, .github/actions/log-api-budget/rate-guard.test.mjs, .github/actions/open-lane-output/README.md, .github/actions/report-check-run/README.md, .github/actions/request-lane-token/README.md, .github/actions/request-lane-token/action.yml, .github/actions/request-lane-token/request-lane-token.test.mjs, .github/actions/resolve-config/README.md, .github/actions/resolve-config/callers.test.mjs, .github/actions/resolve-config/dispatch-limits.test.mjs, .github/actions/resolve-config/lane-grants.test.mjs, .github/actions/resolve-config/live-config.test.mjs, .github/actions/resolve-config/patch-rules.schema.json, .github/actions/resolve-config/resolve-config.test.mjs, .github/actions/resolve-config/resolve.test.mjs, .github/actions/resolve-config/self-checks.test.mjs, .github/actions/resolve-config/verify-scripts.test.mjs, .github/actions/resolve-config/web-access.test.mjs, .github/actions/seal-lane-output/README.md, .github/actions/seal-lane-output/seal.mjs, .github/actions/seal-lane-output/seal.test.mjs, .github/actions/select-trusted-text/README.md, .github/actions/upload-lane-transcript/README.md, .github/actions/upload-lane-transcript/seal-transcript.mjs, .github/dependabot.yml, .github/lane-funding.schema.json, .github/scripts/apply-patch/apply-patch.test.mjs, .github/scripts/apply-patch/deny-rules.test.mjs, .github/scripts/apply-patch/protected-paths.test.mjs, .github/scripts/branch-cleanup/cleanup.mjs, .github/scripts/branch-cleanup/cleanup.test.mjs, .github/scripts/branch-cleanup/rules.mjs, .github/scripts/branch-cleanup/workflow.test.mjs, .github/scripts/intake-reenter/reenter.mjs, .github/scripts/intake-triage/admit.mjs, .github/scripts/intake-triage/admit.test.mjs, .github/scripts/intake-triage/refine.test.mjs, .github/scripts/maintenance-audit-lane-runs/collect.test.mjs, .github/scripts/maintenance-audit-lane-runs/findings.test.mjs, .github/scripts/maintenance-audit-lane-runs/prompt.md, .github/scripts/maintenance-audit-lane-runs/workflow.test.mjs, .github/scripts/maintenance-monitor-signals/workflow.test.mjs, .github/scripts/maintenance-tidy-code-upkeep/upkeep.test.mjs, .github/scripts/plugin-eval/hill-climb-edit.test.mjs, .github/scripts/plugin-eval/select-plugins.test.mjs, .github/scripts/post-merge-demotion-alert/merge-path.mjs, .github/scripts/post-merge-demotion-alert/merge-path.test.mjs, .github/scripts/post-merge-demotion-alert/red-main.mjs, .github/scripts/post-merge-demotion-alert/red-main.test.mjs, .github/scripts/post-merge-demotion-alert/report.mjs, .github/scripts/post-merge-demotion-alert/report.test.mjs, .github/scripts/post-merge-demotion-alert/workflow.test.mjs, .github/scripts/post-merge-test-mutation/execute.test.mjs, .github/scripts/post-merge-test-mutation/generate.prompt.md, .github/scripts/post-merge-test-mutation/triage.prompt.md, .github/scripts/pr-merge/clear-escalations.mjs, .github/scripts/pr-merge/clear-escalations.test.mjs, .github/scripts/pr-merge/enable-auto-merge.mjs, .github/scripts/pr-merge/enable-auto-merge.test.mjs, .github/scripts/pr-merge/merge-holds.test.mjs, .github/scripts/pr-merge/merge-job.test.mjs, .github/scripts/pr-merge/post-unarmed-status.mjs, .github/scripts/pr-merge/refire-refused.test.mjs, .github/scripts/pr-merge/release-eval-hold.mjs, .github/scripts/pr-merge/workflow.test.mjs, .github/scripts/pr-refine/plan-passes.test.mjs, .github/scripts/pr-review-main/prompt.md, .github/scripts/pr-review-main/workflow.test.mjs, .github/scripts/pr-review/wait-refine.test.mjs, .github/scripts/pr-unblock/address-feedback.mjs, .github/scripts/pr-unblock/address-feedback.test.mjs, .github/scripts/pr-unblock/adjudicate-feedback.test.mjs, .github/scripts/pr-unblock/apply-dependency-verdict.test.mjs, .github/scripts/pr-unblock/dependency-classify.mjs, .github/scripts/pr-unblock/dispatch.test.mjs, .github/scripts/pr-unblock/feedback-dispatch.mjs, .github/scripts/pr-unblock/feedback-dispatch.test.mjs, .github/scripts/pr-unblock/fix-ci-context.mjs, .github/scripts/pr-unblock/gate-recheck.test.mjs, .github/scripts/pr-unblock/gate-source.mjs, .github/scripts/pr-unblock/gate-source.test.mjs, .github/scripts/pr-unblock/publish-feedback.test.mjs, .github/scripts/pr-unblock/request-budget.mjs, .github/scripts/pr-unblock/request-budget.test.mjs, .github/scripts/pr-unblock/thread-scope.test.mjs, .github/scripts/pr-verify/probe/fixtures/06-blocking-missing-criterion/diff.patch, .github/scripts/pr-verify/probe/fixtures/21-blocking-unjudged-binary/diff.patch, .github/scripts/pr-verify/resolve-pr.test.mjs, .github/scripts/pr-verify/upstream-jobs.test.mjs, .github/scripts/pr-verify/workflow.test.mjs, .github/scripts/pr-verify/write-verdict.test.mjs, .github/scripts/release-publish-plugins/decide-rebuild.test.sh, .github/scripts/work-resolve-issue/report-outcome.mjs, .github/scripts/work-resolve-issue/report-outcome.test.mjs, .github/scripts/work-resolve-issue/stop-routes.mjs, .github/scripts/work-resolve-issue/stop-routes.test.mjs, .github/scripts/work-resolve-issue/write-issue.test.mjs, .github/standards/dependabot-policy/policy.json, .github/workflows/maintenance-audit-lane-runs.yml, .github/workflows/maintenance-check-links-online.yml, .github/workflows/maintenance-delete-stale-branches.yml, .github/workflows/maintenance-measure-skill-edit.yml, .github/workflows/maintenance-monitor-signals.yml, .github/workflows/maintenance-reconcile-lost-runs.yml, .github/workflows/post-merge-file-demotion-issues.yml, .github/workflows/pr-check-managed-files-hosted.yml, .github/workflows/pr-require-checks.yml, .github/workflows/pr-run-activity-read.yml, .github/workflows/pr-run-plugin-evals.yml, .github/workflows/pr-test-platforms.yml, .github/workflows/pr-verify.yml, .performance/ratchets.json, scripts/README.md, scripts/affected-tests-live.sh, scripts/affected-tests.sh, scripts/affected-tests.test.sh, scripts/ai-slop-report.test.sh, scripts/as-of-recheck-baseline.txt, scripts/check-adr-numbers.sh, scripts/check-adr-numbers.test.sh, scripts/check-affected.sh, scripts/check-affected.test.sh, scripts/check-app-key-references.sh, scripts/check-artifact-retention.sh, scripts/check-as-of-recheck.sh, scripts/check-as-of-recheck.test.sh, scripts/check-cant-fail-scan.sh, scripts/check-cant-fail-scan.test.sh, scripts/check-changed-links-online.sh, scripts/check-changed-skills.test.sh, scripts/check-changelog-fragments.sh, scripts/check-changelog-fragments.test.sh, scripts/check-changelog-parity.sh, scripts/check-changelog-parity.test.sh, scripts/check-comment-hygiene.sh, scripts/check-conformance-registry.sh, scripts/check-convention-yaml.sh, scripts/check-cost-figures.sh, scripts/check-cost-figures.test.sh, scripts/check-cross-plugin-source-drift.sh, scripts/check-cross-plugin-source-drift.test.sh, scripts/check-data-root.test.sh, scripts/check-declared-prerequisites.mjs, scripts/check-detector-eval-coverage.sh, scripts/check-detector-findings-crosswalk.sh, scripts/check-docs-naming.sh, scripts/check-docs-naming.test.sh, scripts/check-docs-only.test.sh, scripts/check-drive-root-litter.sh, scripts/check-exec-form-windows-probe.sh, scripts/check-guardrails-ps-differential.sh, scripts/check-hook-exec-form.sh, scripts/check-hook-exec-form.test.sh, scripts/check-hook-slow-shapes.sh, scripts/check-hook-userconfig-argv.sh, scripts/check-hooks-description.sh, scripts/check-html-assets.sh, scripts/check-killswitch-hoist.sh, scripts/check-loop-lane-floor-drift.sh, scripts/check-pipefail-grep-q.sh, scripts/check-plugin-imports.sh, scripts/check-plugin-profiles.sh, scripts/check-purged-em-dashes.sh, scripts/check-queue-front-matter.sh, scripts/check-queue-front-matter.test.sh, scripts/check-read-caller-keys.sh, scripts/check-script-contract.test.sh, scripts/check-shell-portability.test.sh, scripts/check-silent-revert.sh, scripts/check-skill-count-claims.sh, scripts/check-skill-count-claims.test.sh, scripts/check-skill-portability.test.sh, scripts/check-spoke-plugin-root.sh, scripts/check-standards-contract-bump.sh, scripts/check-standards-contract-bump.test.sh, scripts/check-test-tmp-cleanup.sh, scripts/check-upstream-drift.sh, scripts/check-upstream-drift.test.sh, scripts/check-vendor-version-bump.test.sh, scripts/check-view-medium-lists.mjs, scripts/check-view-medium-lists.test.mjs, scripts/ci-broker-pin.test.sh, scripts/ci-hold-cost-decision.test.sh, scripts/ci-lanes-pr-hold.test.sh, scripts/ci-review-lanes.test.sh, scripts/contract-clause-registry.json, scripts/cost-figures-baseline.txt, scripts/cross-plugin-source-registry.txt, scripts/docs-only-paths.txt, scripts/em-dash-purged-paths.txt, scripts/emit-windows-path.sh, scripts/guardrails-ps-differential-corpus.jsonl, scripts/lane-transcripts/README.md, scripts/lane-transcripts/pull.mjs, scripts/lib/changed-files.test.sh, scripts/lib/changelog-fragments.test.sh, scripts/lib/test-harness.sh, scripts/lint-shell-filter.test.sh, scripts/maintenance-file-dead-links.test.sh, scripts/pilot-plugin-quality-sim.test.sh, scripts/prerequisites-tools.txt, scripts/repin-ci-workflows.test.sh, scripts/run-plugin-tests-serial.txt, scripts/run-plugin-tests.sh, scripts/shared-copies.txt, scripts/shell-portability-skill-md-baseline.txt, scripts/silent-revert-incidents.txt, scripts/suite-budget-exceptions.txt, scripts/sync-config-cascade-semantics.py, scripts/sync-config-cascade-semantics.test.sh, scripts/sync-plugin-options-docs.py, scripts/test-windows-inert-paths.txt, scripts/test_check_vocabulary.py, scripts/test_count_capture_sources.py, scripts/test_skill_stack_fences.py, scripts/upstream-drift-issues.sh, scripts/upstream-drift-issues.test.sh, scripts/upstream-drift-vendored-report.test.sh, scripts/validate-plugin-contracts.mjs, scripts/validate-plugin-contracts.test.sh, scripts/vocabulary-senses.json.
  • Open the pull request with Closes this issue in its body, then stop: the lane adds no label. A sweep adds do-not-merge and the hold line when the pull request opens; the evidence below is a host session's work.

After the pull request opens (host session, not the lane)

The lane opens the pull request and stops there. The pull request stays held with do-not-merge for the eval; a host session runs only the eval and posts its record on the pull request; the merge lane releases the hold when the record matches the head; this issue closes with the pull request.

  • Hold line: the hub's sweep (or a host session) adds do-not-merge to the pull request and posts, from a listed human's account, a comment with the line <!-- pr-hold reason=eval --> on a line of its own.
  • Targeted case per changed skill (this replaces Classify the remaining guidance rows blind and count the cuts per plugin #15730's "no more than 400 runs per plugin (the changed skills' cases on the opus and sonnet aliases, three runs per side, plus control sides on one model)"): one before-and-after case, on sonnet at 3 runs a side; opus runs only to confirm a sonnet loss; a new case gets a 1 to 3 run smoke first (owner decision of 2026-11-16 in the owner-decisions record, superseding the run counts in #15703 comment 6906800940). Select cases with --case, use --runs 3 and a --max-cost-usd ceiling, and start no batch after a usage-limit error.
  • Controls: each whole-page deletion carries a sensitivity-control result, its predicted outcome written in the pull request body before the first batch; each partial cut carries a detection-control result. No paired no-loss compare per cut (#15703 comment 6906800940).
  • On a LOSS reading: a trace read of each dropped case and an opus confirm; only a loss traced to the changed text counts (#16672 comment 6935228111).
  • R8 rows: the row's targeted case with and without the row. On a case drop or a mean fall of 0.15 or more without it, the host session restores the row on the pull request branch, annotated portability-ok: measured <case-id>; otherwise it stays cut. A deterministic grader states before the run in how many of n runs it must fail.
  • Record: the verdict and the control result go into the pull request body. When the run is VALID and shows no loss, the host session posts, from a listed human's account, a comment with the line <!-- eval-pair verdict=no-loss validity=VALID head=<40-hex head SHA> --> naming the pull request's current head, and keeps "do not merge" and do-not-merge out of that comment (docs/contracts/loop-lane/README.md, "Cross-lane PR hold"). A loss or a run that is not VALID leaves the hold in place; say so on the pull request.
  • Release: pr-merge's scheduled step "Release eval holds whose record matches the head" (.github/scripts/pr-merge/release-eval-hold.mjs) removes do-not-merge once that record is the newest since the label went on and names the current head, and no other hold stands. A push after the record needs a new record.
  • AC7 is met here: each whole-page deletion carries a sensitivity-control result and each partial cut a detection-control result, in the pull request body.

Decisions

  • D3: each plugin's cut is its own topic and pull request.
  • Interview Q32 (D4 of the Brief): bundled defaults that pick a tool, command or library are retired wherever they appear.
  • AC1's named exceptions are the kept classes of ADR 0101 (docs/adr/0101-resolve-ecosystem-specifics-from-the-consumer-repository.md, Decision and the 2026-11-17 amendment).
  • Bulk-mutation standard: count first, then act; the pull request states its row count.
  • The rules this item's rows fall under (rules revision 5):
    • R11 (shipped knowledge): everything else that is model-read K2, K3, K4, K5 or K7. Goes through the cutting route: the generic text replaces it only at a routing site where the skill still takes a language-specific step; anywhere else it is deleted with no replacement. An item kept only because a removed item consumes it goes in the same pull request.
    • R4 (consumer default): the value picks a tool or library for the consumer. Goes: no bundled default survives (ADR 0101 decision 2, "Ship no bundled default"); the choice is resolved from the consumer.
    • R8 (measured fact): it records a measurement or probe of an outside tool that contradicts a reasonable default, or pairs our rule id with an outside diagnostic. Moves into the record at drafting time when a record key can hold it; otherwise stays as one stamped row annotated portability-ok: measured <case-id> only if the row's targeted case shows a case drop or a mean fall of 0.15 or more without it, under the eval policy in force; a deterministic grader states before the run in how many of n runs it must fail; else goes.

Key interfaces

  • "The consumer's ecosystem (language, framework, tools): abstract now. Seam: the ecosystem-resolution contract and the consumer's own records."
  • Conventions followed: a cut ships with eval evidence (the skills-and-agents review rules).

Done when

  • AC1 (this plugin's share): mutation-testing ships no model-read tool, library or command choice outside the named exceptions; each listed R11 and R4 row is cut, and each R8 row is cut and marked pending its targeted case.
  • The pull request body states the row count (22) and lists every row id with its rule and outcome.
  • Each R11 row's script-reader search is quoted in the pull request body.
  • The pull request body names, for each changed skill, the existing case that reads the cut text, or says none does.
  • The pull request body says, for each changed file, whether the cut deletes the whole page or part of it.
  • AC10: no new enforcement-placing skill is added here.

Out of scope

Activity

  1. added
    agent-readyFully specified and briefed; eligible for autonomous pickup from the frontier.
    on Nov 17, 2026
  2. added theissue type on Nov 17, 2026
  3. updated Work status ready and Priority medium on Nov 17, 2026
  4. melodic-automation-lanes commented on Nov 17, 2026

    @melodic-automation-lanes
    Contributor

    Not admitted to the issue lane yet: Size large: the split into sub-issues at intake is pending (owner Q93).

  5. added
    host-runNeeds an unattended run on a host; the host runner takes it, not a person or the issue lane.
    on Nov 17, 2026
  6. removed
    host-runNeeds an unattended run on a host; the host runner takes it, not a person or the issue lane.
    on Nov 17, 2026
  7. melodic-automation-lanes commented on Nov 17, 2026

    @melodic-automation-lanes
    Contributor

    The work-resolve-issue lane stopped on this issue (split-required): the issue's Size is too large for one run, and intake's split (owner Q93) files its sub-issues.
    Its Size is too large for one run: intake splits it into sub-issues (owner Q93).
    It set Work status to needs-triage, so the hourly triage sweep sends it back through intake triage, and it waits on no decision from a person.

    Run: https://github.com/melodic-software/claude-code-plugins/actions/runs/44145781401

  8. github-actions commented on Nov 17, 2026

    @github-actions
    Contributor

    Intake triage did not triage this issue after 2 dispatches, so the sweep no longer dispatches it and set its Work status to needs-triage for a maintainer. Triage it by hand, and read the runs for why intake did not:

  9. github-actions commented on Nov 17, 2026

    @github-actions
    Contributor

    Size: Large
    Complexity: Medium
    Uncertainty: Known
    Flags: none
    Blocked by: none
    Blast radius: the mutation-testing plugin's skills, reference pages and README, plus about 20 baseline, ratchet and script entries that name the cut files. The plugin's users and the CI checks that read those entries are affected.
    Reversible: yes; revert the pull request, or restore a single R8 row with a portability-ok: measured <case-id> annotation.
    Open questions: none
    I read this as a cut of 22 model-read ecosystem-specific rows in mutation-testing (R11 19, R4 2, R8 1). Each row is cut or replaced at a routing site. The pull request body must state the row count, the script-reader searches, the eval cases that read the cut text, and whole-page versus partial deletion. The issue gives the route, the rules and the done-when items, so no decision is missing. It lists no blockers. I found no open duplicate and no merged pull request that already does this cut. The size is Large because the reference-update list touches many files, though it stays one plugin's cut under D3.

    Automated triage. A maintainer reviews it.

  10. melodic-automation-lanes commented on Nov 17, 2026

    @melodic-automation-lanes
    Contributor

    Not split at intake (owner Q93). This issue stays parked at status: ready: no split into whole changes was found, either by task-list line or by the targets the lines name. No person is asked to act and no hold label is added. The split settings are size-split in .github/actions/resolve-config/admission-rules.json.

    Automated by the lanes App, once per reason and body version.

  11. kyle-sexton commented on Nov 21, 2026

    @kyle-sexton
    MemberAuthor

    Split by hand into #17731, #17733, #17739 (native sub-issues, each Small or Medium, each eval-gated): intake sized this issue Large and its size split declined no-split. Most of the Large rating came from the "References outside the plugin" list, which was built by bare file name and pulls in about 300 unrelated files. Each child lists only the outside references a full-path git grep finds. Each child carries its rows, the rules and the host-session eval method, and closes with its own pull request. This issue's AC1 is met when every child closes by merge; the per-PR done-when lines live on the children.

  12. removed
    agent-readyFully specified and briefed; eligible for autonomous pickup from the frontier.
    on Nov 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    Fields

    Work status

    needs-triage

    Priority

    medium

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions