Repository navigation
Description
Parent
Refs #15703
Source: #15730 (blind classification under rules revision 5, #15730 comment 6950077480), cut item 6 of 47 in its filing order.
Depends on
- none open. The route this cut follows is in place: Add the ecosystem-resolution contract, its decision record and the review rule #15706 (ecosystem-resolution contract and review rule), Add the whole-page sensitivity-control clause to the four cut-proof rules #15707 (sensitivity-control clause), Cut the per-language property pages from testing:write as the pilot #15709 (the pilot cut), all closed.
Blocks #15732 (the portability gate widens only after every cut lands).
Outcome
testing ships no model-read tool, library or command choice outside ADR 0101's named exceptions: the 26 rows below are cut (R11 24, R4 2).
Demo: on main after the merge, each listed row's cited text is gone or replaced by generic text at a routing site, and the pull request body lists every row id with what happened to it.
Row count (bulk-mutation standard): 26 rows. The pull request states this number and lists each row.
Rows to cut
Paths are repository-relative; line numbers are as read at 5b66a7fa and may have moved. Kind is the inventory kind (K2 detection table, K3 bundled value, K4 tool guidance, K5 tool pointer, K7 example).
| Row | Rule | Kind | Cited at | Fact the classifier matched | Notes |
|---|---|---|---|---|---|
| D22 | R4 | K3 | plugins/testing/.claude-plugin/plugin.json:35-39; plugins/testing/schemas/testing.schema.json:55-60; plugins/testing/scripts/resolve-config.sh:258; plugins/testing/skills/run-e2e/context/e2e-config.md:34,91-101,123 |
browser_driver defaults to playwright-cli (plugin.json userConfig, testing.schema.json:57, resolve-config.sh:266), choosing the browser tool for the consumer, and run-e2e's description names no Playwright scope. |
|
| F0421 | R11 | K7 | plugins/testing/skills/write/SKILL.md:94 |
write/SKILL.md:94 still gives .NET/xUnit naming forms as an illustration of the neutral naming rule; it is a model-read K7 example that no earlier rule holds. |
|
| F0422 | R11 | K4 | plugins/testing/skills/write/SKILL.md:119 |
The .NET framework-traps gotcha (MTP dotnet test options, global.json, nesting) is still at write/SKILL.md:119, and the write description names no language, so it is model-read guidance. |
|
| F0423 | R11 | K7 | plugins/testing/skills/write/context/write.md:50,56-59,95,137-157 |
write.md still has the Aspire/docker-compose/tilt row, the .NET/xUnit naming forms, the JS hollow-out example and the C# database-read example; all are model-read examples of neutral rules. |
|
| F0425 | R11 | K7 | plugins/testing/skills/write/context/organize.md:13,53-54 |
organize.md still uses {Project}.Tests "in .NET" and {ClassUnderTest}Tests as .NET illustrations of the neutral placement and naming rules. |
|
| F0426 | R11 | K4 | plugins/testing/skills/write/context/organize.md:47-49 |
The section was retitled "Nested test projects (.NET)" and now points at the MS Learn default-includes page, but the .NET-only nesting guidance is still there and is model-read. | |
| F0427 | R11 | K5 | plugins/testing/skills/write/context/property.md:94-106,143-148 |
The Hypothesis @example and fast-check examples mechanics and their doc links remain (property.md 99-111) as model-read tool pointers; the /hypothesis command section (old 143-148) is gone. |
|
| F0432 | R11 | K5 | plugins/testing/skills/write/context/characterization.md:72-77 |
The write characterization.md Sources lines for Scientist, Verify scrubbers, Jest snapshots and ApprovalTests are tool-documentation links, which R9 excludes. |
Two readings (other: R9). Reader's note: F0412, F0414, F0432, F0434: the same lines also cite papers or author pages (Maaz, Vikram, Feathers, Seemann, Fowler's ContractTest) that would be R9 alone; the rule follows the inventoried tool-doc links. |
| F0433 | R11 | K4 | plugins/testing/skills/test-value/SKILL.md:107-112 |
The EF Core carve-out (mock DbContext for writes, never DbSet for queries, plus the MS Learn pointers) is model-read .NET guidance in test-value, whose description names no ecosystem. |
|
| F0434 | R11 | K5 | plugins/testing/skills/test-value/SKILL.md:76-85 |
The canned-response verification record's Pact and vcrpy links are tool documentation (R9 excludes them), so the tool pointers fall to model-read K5. | Two readings (other: R9). Reader's note: F0412, F0414, F0432, F0434: the same lines also cite papers or author pages (Maaz, Vikram, Feathers, Seemann, Fowler's ContractTest) that would be R9 alone; the rule follows the inventoried tool-doc links. |
| F0436 | R11 | K4 | plugins/testing/skills/diagnose/SKILL.md:96 |
The diagnose .NET framework-traps gotcha (MTP options, exit codes, global.json) is still present, and it is model-read guidance in a skill whose description names no language. |
|
| F0437 | R11 | K4 | plugins/testing/skills/diagnose/context/investigate.md:11-19 |
The investigate.md classification rows (WebApplicationFactory singleton, MTP --nologo versus --no-banner, sync-over-async) are still present as model-read .NET guidance. |
|
| F0438 | R11 | K5 | plugins/testing/skills/diagnose/context/investigate.md:21,25 |
investigate.md 21 and 25 still name the xUnit filter, pytest -k, vitest, pytest-randomly and go test -shuffle, with links, as the next thing to use. |
|
| F0439 | R11 | K7 | plugins/testing/skills/diagnose/context/loop.md:58-66 |
loop.md Step 5 still has the dotnet test block, labeled "illustrative (.NET)", as an example of the neutral run-the-full-suite rule. |
|
| F0440 | R11 | K7 | plugins/testing/skills/plan/SKILL.md:59-63,70-86 |
plan/SKILL.md still has the WebApplicationFactory, Testcontainers/Docker Compose and Blazor rows and the .NET/xUnit name placeholders as model-read examples. |
|
| F0441 | R11 | K4 | plugins/testing/skills/run-e2e/context/e2e.md:5-29 |
The e2e.md prerequisites matrix (the @playwright/cli 0.1.x floor, npm install -g @playwright/cli, Chrome DevTools MCP, Claude in Chrome) is model-read tool guidance. |
|
| F0442 | R11 | K4 | plugins/testing/skills/run-e2e/context/e2e.md:51-108 |
The Browser-tool rubric and driver ranking in e2e.md say which third-party browser tool (Playwright CLI/MCP, Chrome DevTools MCP, @playwright/test) fits which job; this is model-read guidance. |
|
| F0443 | R11 | K4 | plugins/testing/skills/run-e2e/context/e2e.md:110-185 |
The flow-suite and render-check sections in e2e.md (@playwright/test, Cypress, @axe-core/playwright, toHaveScreenshot) are model-read tool guidance. |
|
| F0444 | R11 | K4 | plugins/testing/skills/run-e2e/context/e2e.md:225-300 |
The e2e.md workflow steps give curl/jq and playwright-cli -s=<session> ... command sequences as model-read how-to for a tool that no kept adapter of this marketplace drives. |
|
| F0445 | R11 | K4 | plugins/testing/skills/run-e2e/context/own-driving.md:27-40,114-135,192-201 |
The inventoried subject is the playwright-cli session usage (-s='<name>' close, never close-all) in own-driving.md, which is model-read how-to for a tool that no kept adapter drives. |
Two readings (other: R4, R6). Reader's note: F0445: lines 27-40 and 114-135 are about this marketplace's keys and check-browser-driver.sh (R6), and line 35-36 restates the playwright-cli default (R4); the rule follows the inventoried subject, playwright-cli sessions. |
| F0446 | R11 | K4 | plugins/testing/skills/run-e2e/context/non-ui.md:17-28 |
The non-ui.md surface table still names WebApplicationFactory, Aspire AppHost, bats, pytest via uv, PSScriptAnalyzer, Pester and script -q as the live-test patterns. |
|
| F0447 | R11 | K4 | plugins/testing/skills/run-e2e/context/non-ui.md:50-59 |
The non-ui.md per-runtime spawn table (node/npm, dotnet run, uv run) and its harness choice (vitest, xUnit, pytest) are model-read guidance. |
|
| F0448 | R11 | K5 | plugins/testing/skills/run-e2e/SKILL.md:34-35,346,358,374-375 |
Its inventoried tools (Aspire, docker-compose, tilt, Playwright CLI, axe) are third-party tools that run-e2e/SKILL.md names as examples and pointers; they are model-read K5. |
Two readings (other: R4). Reader's note: F0448 and F0449: both have the plugin-rename trigger, but F0448's tools column names only third-party tools, and line 374 "Playwright CLI is the default" could be read as R4. F0449's only item is the /playwright:playwright skill; if a skill pointer is not a file of this marketplace, F0449 is R11. |
| F0450 | R11 | K4 | plugins/testing/skills/check-visual-parity/SKILL.md:35-58 |
The capture-route step names Playwright toHaveScreenshot, Storybook and the Playwright CLI, none of which the check-visual-parity description names, so it is model-read tool guidance. |
|
| F0452 | R11 | K7 | plugins/testing/skills/cleanup/SKILL.md:206,342 |
cleanup/SKILL.md still has the C# using note and the ".NET suite, 3 of 42" anecdote as .NET illustrations of neutral rules. |
|
| F0453 | R4 | K6 | plugins/testing/README.md:12-17,102-116,194-196 |
The README's browser_driver text and options row state the default playwright-cli, a value that picks the browser tool for the consumer. |
Two readings (other: R6, R7). Reader's note: F0453: lines 12-17 hold a coverage claim ("thirteen rules across JS/TS, ...") that is R7 material, and the e2e_driver ids printed by resolve-config.sh are R6 material; R4 is tested first and holds on the playwright-cli default. |
Kept rows, not touched here (count per rule): R3 1, R6 8. 2 more rows were answered GONE (cited content no longer on main) and need nothing.
Steps
- List every item with its rule: the pull request body repeats the table above with each row's outcome (cut, replaced at a routing site, or kept with its reason).
- Back every R11 call with a search showing whether a script reads the file, for example
git grep -n -F '<file name>' -- plugins scripts .github, quoted in the pull request body. A row whose file a script reads is not cut here: report it on Classify the remaining guidance rows blind and count the cuts per plugin #15730. - Name the cases that read the cut text: in the pull request body, name for each changed skill the existing eval case whose run reads the cut text, or say that none does. The lane names them; it runs none.
- Whole page or part: in the pull request body, say for each changed file whether the cut deletes the whole page or part of it.
- R4 rows: the bundled default goes; the choice is resolved from the consumer through the ecosystem-resolution contract (
docs/contracts/ecosystem-resolution/). A shipped default that picks a library goes with this cut. - Fence ratchet: lower the
skill-stack-fencesceiling in.performance/ratchets.jsonfor each of these files whose fences the cut removes:plugins/testing/skills/write/context/write.md. - References outside the plugin: these files on
mainname a cut file; update or remove each entry the cut makes stale:plugins/testing/.claude-plugin/plugin.jsonin.github/scripts/apply-patch/apply-patch.test.mjs,.github/scripts/apply-patch/protected-paths.test.mjs,.github/scripts/plugin-eval/deterministic-suite.test.mjs,.github/scripts/plugin-eval/hill-climb-edit.test.mjs,.github/scripts/plugin-eval/select-plugins.test.mjs,.github/scripts/plugin-eval/stage-suites.sh,.github/scripts/pr-merge-risk/write-rating.mjs,.github/scripts/pr-merge/clear-escalations.test.mjs,.github/scripts/pr-merge/enable-auto-merge.test.mjs,.github/scripts/pr-merge/merge-holds.test.mjs,.github/scripts/pr-unblock/adjudicate-feedback.mjs,.github/scripts/pr-unblock/adjudicate-feedback.test.mjs,.github/scripts/pr-unblock/thread-scope.test.mjs,.github/scripts/release-publish-plugins/decide-rebuild.test.sh,.github/workflows/maintenance-measure-skill-edit-pass.yml,.github/workflows/maintenance-measure-skill-edit.yml,.github/workflows/pr-rate-merge-risk.yml,.github/workflows/pr-require-checks.yml,scripts/affected-tests-live.sh,scripts/affected-tests-no-suite.txt,scripts/affected-tests.test.sh,scripts/check-changelog-fragments.sh,scripts/check-changelog-fragments.test.sh,scripts/check-changelog-parity.sh,scripts/check-changelog-parity.test.sh,scripts/check-data-root.test.sh,scripts/check-docs-only.test.sh,scripts/check-exec-form-windows-probe.test.sh,scripts/check-hook-exec-form.test.sh,scripts/check-hook-slow-shapes.test.sh,scripts/check-hook-userconfig-argv.sh,scripts/check-hook-userconfig-argv.test.sh,scripts/check-killswitch-hoist.test.sh,scripts/check-manifest-duplicate-keys.py,scripts/check-plugin-manifest-presence.sh,scripts/check-plugin-manifest-presence.test.sh,scripts/check-script-contract.test.sh,scripts/check-skill-count-claims.sh,scripts/check-skill-count-claims.test.sh,scripts/check-standards-contract-bump.sh,scripts/check-standards-contract-bump.test.sh,scripts/check-vendor-version-bump.sh,scripts/check-vendor-version-bump.test.sh,scripts/ci-hold-human-gated.test.sh,scripts/ci-lanes-pr-hold.test.sh,scripts/dependabot-fragments.sh,scripts/dependabot-fragments.test.sh,scripts/docs-only-paths.txt,scripts/generate-catalog.test.sh,scripts/generate-marketplace.mjs,scripts/generate-marketplace.test.sh,scripts/lib/changelog-fragments.sh,scripts/lib/changelog-fragments.test.sh,scripts/lib/hook-configs.sh,scripts/lib/hook-configs.test.sh,scripts/lint-shell-filter.test.sh,scripts/new-changelog-fragment.sh,scripts/new-changelog-fragment.test.sh,scripts/node-notice-rows.test.sh,scripts/plugin-validate-report.test.sh,scripts/release-plugins.sh,scripts/release-plugins.test.sh,scripts/resolve-diff-base.test.sh,scripts/silent-revert-incidents.txt,scripts/sync-plugin-options-docs.py,scripts/sync-shared-copies.sh,scripts/sync-shared-copies.test.sh,scripts/test_check_manifest_duplicate_keys.py,scripts/validate-plugin-contracts.test.sh,scripts/validate-plugins.sh,scripts/validate-plugins.test.sh;plugins/testing/scripts/resolve-config.shin.github/scripts/pr-verify/workflow.test.mjs,.github/workflows/pr-verify-capture.yml;plugins/testing/skills/write/SKILL.mdin.github/scripts/plugin-eval/hill-climb-edit.test.mjs,.github/scripts/plugin-eval/hill-climb-publish.test.mjs;plugins/testing/skills/write/context/write.mdin.performance/ratchets.json;plugins/testing/skills/write/context/characterization.mdinscripts/docs-anchor-baseline.txt;plugins/testing/skills/test-value/SKILL.mdinscripts/docs-anchor-baseline.txt;plugins/testing/skills/run-e2e/context/e2e.mdinscripts/docs-anchor-baseline.txt;plugins/testing/skills/run-e2e/SKILL.mdin.github/scripts/pr-verify/workflow.test.mjs;plugins/testing/README.mdin.github/CODEOWNERS,.github/actions/check-kill-switch/README.md,.github/actions/check-signed-commits/README.md,.github/actions/check-trusted-trigger/README.md,.github/actions/check-trusted-trigger/check-trusted-trigger.test.mjs,.github/actions/check-wip-cap/check-wip-cap.mjs,.github/actions/collect-base-activity/action.yml,.github/actions/collect-base-activity/collect-base-activity.test.mjs,.github/actions/log-api-budget/rate-guard.test.mjs,.github/actions/open-lane-output/README.md,.github/actions/report-check-run/README.md,.github/actions/request-lane-token/README.md,.github/actions/request-lane-token/action.yml,.github/actions/request-lane-token/request-lane-token.test.mjs,.github/actions/resolve-config/README.md,.github/actions/resolve-config/callers.test.mjs,.github/actions/resolve-config/dispatch-limits.test.mjs,.github/actions/resolve-config/lane-grants.test.mjs,.github/actions/resolve-config/live-config.test.mjs,.github/actions/resolve-config/patch-rules.schema.json,.github/actions/resolve-config/resolve-config.test.mjs,.github/actions/resolve-config/resolve.test.mjs,.github/actions/resolve-config/self-checks.test.mjs,.github/actions/resolve-config/verify-scripts.test.mjs,.github/actions/resolve-config/web-access.test.mjs,.github/actions/seal-lane-output/README.md,.github/actions/seal-lane-output/seal.mjs,.github/actions/seal-lane-output/seal.test.mjs,.github/actions/select-trusted-text/README.md,.github/actions/upload-lane-transcript/README.md,.github/actions/upload-lane-transcript/seal-transcript.mjs,.github/dependabot.yml,.github/lane-funding.schema.json,.github/scripts/apply-patch/apply-patch.test.mjs,.github/scripts/apply-patch/deny-rules.test.mjs,.github/scripts/apply-patch/protected-paths.test.mjs,.github/scripts/branch-cleanup/cleanup.mjs,.github/scripts/branch-cleanup/cleanup.test.mjs,.github/scripts/branch-cleanup/rules.mjs,.github/scripts/branch-cleanup/workflow.test.mjs,.github/scripts/intake-reenter/reenter.mjs,.github/scripts/intake-triage/admit.mjs,.github/scripts/intake-triage/admit.test.mjs,.github/scripts/intake-triage/refine.test.mjs,.github/scripts/maintenance-audit-lane-runs/collect.test.mjs,.github/scripts/maintenance-audit-lane-runs/findings.test.mjs,.github/scripts/maintenance-audit-lane-runs/prompt.md,.github/scripts/maintenance-audit-lane-runs/workflow.test.mjs,.github/scripts/maintenance-monitor-signals/workflow.test.mjs,.github/scripts/maintenance-tidy-code-upkeep/upkeep.test.mjs,.github/scripts/plugin-eval/hill-climb-edit.test.mjs,.github/scripts/plugin-eval/select-plugins.test.mjs,.github/scripts/post-merge-demotion-alert/merge-path.mjs,.github/scripts/post-merge-demotion-alert/merge-path.test.mjs,.github/scripts/post-merge-demotion-alert/red-main.mjs,.github/scripts/post-merge-demotion-alert/red-main.test.mjs,.github/scripts/post-merge-demotion-alert/report.mjs,.github/scripts/post-merge-demotion-alert/report.test.mjs,.github/scripts/post-merge-demotion-alert/workflow.test.mjs,.github/scripts/post-merge-test-mutation/execute.test.mjs,.github/scripts/post-merge-test-mutation/generate.prompt.md,.github/scripts/post-merge-test-mutation/triage.prompt.md,.github/scripts/pr-merge/clear-escalations.mjs,.github/scripts/pr-merge/clear-escalations.test.mjs,.github/scripts/pr-merge/enable-auto-merge.mjs,.github/scripts/pr-merge/enable-auto-merge.test.mjs,.github/scripts/pr-merge/merge-holds.test.mjs,.github/scripts/pr-merge/merge-job.test.mjs,.github/scripts/pr-merge/post-unarmed-status.mjs,.github/scripts/pr-merge/refire-refused.test.mjs,.github/scripts/pr-merge/release-eval-hold.mjs,.github/scripts/pr-merge/workflow.test.mjs,.github/scripts/pr-refine/plan-passes.test.mjs,.github/scripts/pr-review-main/prompt.md,.github/scripts/pr-review-main/workflow.test.mjs,.github/scripts/pr-review/wait-refine.test.mjs,.github/scripts/pr-unblock/address-feedback.mjs,.github/scripts/pr-unblock/address-feedback.test.mjs,.github/scripts/pr-unblock/adjudicate-feedback.test.mjs,.github/scripts/pr-unblock/apply-dependency-verdict.test.mjs,.github/scripts/pr-unblock/dependency-classify.mjs,.github/scripts/pr-unblock/dispatch.test.mjs,.github/scripts/pr-unblock/feedback-dispatch.mjs,.github/scripts/pr-unblock/feedback-dispatch.test.mjs,.github/scripts/pr-unblock/fix-ci-context.mjs,.github/scripts/pr-unblock/gate-recheck.test.mjs,.github/scripts/pr-unblock/gate-source.mjs,.github/scripts/pr-unblock/gate-source.test.mjs,.github/scripts/pr-unblock/publish-feedback.test.mjs,.github/scripts/pr-unblock/request-budget.mjs,.github/scripts/pr-unblock/request-budget.test.mjs,.github/scripts/pr-unblock/thread-scope.test.mjs,.github/scripts/pr-verify/probe/fixtures/06-blocking-missing-criterion/diff.patch,.github/scripts/pr-verify/probe/fixtures/21-blocking-unjudged-binary/diff.patch,.github/scripts/pr-verify/resolve-pr.test.mjs,.github/scripts/pr-verify/upstream-jobs.test.mjs,.github/scripts/pr-verify/workflow.test.mjs,.github/scripts/pr-verify/write-verdict.test.mjs,.github/scripts/release-publish-plugins/decide-rebuild.test.sh,.github/scripts/work-resolve-issue/report-outcome.mjs,.github/scripts/work-resolve-issue/report-outcome.test.mjs,.github/scripts/work-resolve-issue/stop-routes.mjs,.github/scripts/work-resolve-issue/stop-routes.test.mjs,.github/scripts/work-resolve-issue/write-issue.test.mjs,.github/standards/dependabot-policy/policy.json,.github/workflows/maintenance-audit-lane-runs.yml,.github/workflows/maintenance-check-links-online.yml,.github/workflows/maintenance-delete-stale-branches.yml,.github/workflows/maintenance-measure-skill-edit.yml,.github/workflows/maintenance-monitor-signals.yml,.github/workflows/maintenance-reconcile-lost-runs.yml,.github/workflows/post-merge-file-demotion-issues.yml,.github/workflows/pr-check-managed-files-hosted.yml,.github/workflows/pr-require-checks.yml,.github/workflows/pr-run-activity-read.yml,.github/workflows/pr-run-plugin-evals.yml,.github/workflows/pr-test-platforms.yml,.github/workflows/pr-verify.yml,.performance/ratchets.json,scripts/README.md,scripts/affected-tests-live.sh,scripts/affected-tests.sh,scripts/affected-tests.test.sh,scripts/ai-slop-report.test.sh,scripts/as-of-recheck-baseline.txt,scripts/check-adr-numbers.sh,scripts/check-adr-numbers.test.sh,scripts/check-affected.sh,scripts/check-affected.test.sh,scripts/check-app-key-references.sh,scripts/check-artifact-retention.sh,scripts/check-as-of-recheck.sh,scripts/check-as-of-recheck.test.sh,scripts/check-cant-fail-scan.sh,scripts/check-cant-fail-scan.test.sh,scripts/check-changed-links-online.sh,scripts/check-changed-skills.test.sh,scripts/check-changelog-fragments.sh,scripts/check-changelog-fragments.test.sh,scripts/check-changelog-parity.sh,scripts/check-changelog-parity.test.sh,scripts/check-comment-hygiene.sh,scripts/check-conformance-registry.sh,scripts/check-convention-yaml.sh,scripts/check-cost-figures.sh,scripts/check-cost-figures.test.sh,scripts/check-cross-plugin-source-drift.sh,scripts/check-cross-plugin-source-drift.test.sh,scripts/check-data-root.test.sh,scripts/check-declared-prerequisites.mjs,scripts/check-detector-eval-coverage.sh,scripts/check-detector-findings-crosswalk.sh,scripts/check-docs-naming.sh,scripts/check-docs-naming.test.sh,scripts/check-docs-only.test.sh,scripts/check-drive-root-litter.sh,scripts/check-exec-form-windows-probe.sh,scripts/check-guardrails-ps-differential.sh,scripts/check-hook-exec-form.sh,scripts/check-hook-exec-form.test.sh,scripts/check-hook-slow-shapes.sh,scripts/check-hook-userconfig-argv.sh,scripts/check-hooks-description.sh,scripts/check-html-assets.sh,scripts/check-killswitch-hoist.sh,scripts/check-loop-lane-floor-drift.sh,scripts/check-pipefail-grep-q.sh,scripts/check-plugin-imports.sh,scripts/check-plugin-profiles.sh,scripts/check-purged-em-dashes.sh,scripts/check-queue-front-matter.sh,scripts/check-queue-front-matter.test.sh,scripts/check-read-caller-keys.sh,scripts/check-script-contract.test.sh,scripts/check-shell-portability.test.sh,scripts/check-silent-revert.sh,scripts/check-skill-count-claims.sh,scripts/check-skill-count-claims.test.sh,scripts/check-skill-portability.test.sh,scripts/check-spoke-plugin-root.sh,scripts/check-standards-contract-bump.sh,scripts/check-standards-contract-bump.test.sh,scripts/check-test-tmp-cleanup.sh,scripts/check-upstream-drift.sh,scripts/check-upstream-drift.test.sh,scripts/check-vendor-version-bump.test.sh,scripts/check-view-medium-lists.mjs,scripts/check-view-medium-lists.test.mjs,scripts/ci-broker-pin.test.sh,scripts/ci-hold-cost-decision.test.sh,scripts/ci-lanes-pr-hold.test.sh,scripts/ci-review-lanes.test.sh,scripts/contract-clause-registry.json,scripts/cost-figures-baseline.txt,scripts/cross-plugin-source-registry.txt,scripts/docs-only-paths.txt,scripts/em-dash-purged-paths.txt,scripts/emit-windows-path.sh,scripts/guardrails-ps-differential-corpus.jsonl,scripts/lane-transcripts/README.md,scripts/lane-transcripts/pull.mjs,scripts/lib/changed-files.test.sh,scripts/lib/changelog-fragments.test.sh,scripts/lib/test-harness.sh,scripts/lint-shell-filter.test.sh,scripts/maintenance-file-dead-links.test.sh,scripts/pilot-plugin-quality-sim.test.sh,scripts/prerequisites-tools.txt,scripts/repin-ci-workflows.test.sh,scripts/run-plugin-tests-serial.txt,scripts/run-plugin-tests.sh,scripts/shared-copies.txt,scripts/shell-portability-skill-md-baseline.txt,scripts/silent-revert-incidents.txt,scripts/suite-budget-exceptions.txt,scripts/sync-config-cascade-semantics.py,scripts/sync-config-cascade-semantics.test.sh,scripts/sync-plugin-options-docs.py,scripts/test-windows-inert-paths.txt,scripts/test_check_vocabulary.py,scripts/test_count_capture_sources.py,scripts/test_skill_stack_fences.py,scripts/upstream-drift-issues.sh,scripts/upstream-drift-issues.test.sh,scripts/upstream-drift-vendored-report.test.sh,scripts/validate-plugin-contracts.mjs,scripts/validate-plugin-contracts.test.sh,scripts/vocabulary-senses.json. - Open the pull request with
Closesthis issue in its body, then stop: the lane adds no label. A sweep addsdo-not-mergeand the hold line when the pull request opens; the evidence below is a host session's work.
After the pull request opens (host session, not the lane)
The lane opens the pull request and stops there. The pull request stays held with do-not-merge for the eval; a host session runs only the eval and posts its record on the pull request; the merge lane releases the hold when the record matches the head; this issue closes with the pull request.
- Hold line: the hub's sweep (or a host session) adds
do-not-mergeto the pull request and posts, from a listed human's account, a comment with the line<!-- pr-hold reason=eval -->on a line of its own. - Targeted case per changed skill (this replaces Classify the remaining guidance rows blind and count the cuts per plugin #15730's "no more than 400 runs per plugin (the changed skills' cases on the
opusandsonnetaliases, three runs per side, plus control sides on one model)"): one before-and-after case, onsonnetat 3 runs a side;opusruns only to confirm a sonnet loss; a new case gets a 1 to 3 run smoke first (owner decision of 2026-11-16 in the owner-decisions record, superseding the run counts in #15703 comment 6906800940). Select cases with--case, use--runs 3and a--max-cost-usdceiling, and start no batch after a usage-limit error. - Controls: each whole-page deletion carries a sensitivity-control result, its predicted outcome written in the pull request body before the first batch; each partial cut carries a detection-control result. No paired no-loss compare per cut (#15703 comment 6906800940).
- On a LOSS reading: a trace read of each dropped case and an
opusconfirm; only a loss traced to the changed text counts (#16672 comment 6935228111). - Record: the verdict and the control result go into the pull request body. When the run is VALID and shows no loss, the host session posts, from a listed human's account, a comment with the line
<!-- eval-pair verdict=no-loss validity=VALID head=<40-hex head SHA> -->naming the pull request's current head, and keeps "do not merge" anddo-not-mergeout of that comment (docs/contracts/loop-lane/README.md, "Cross-lane PR hold"). A loss or a run that is not VALID leaves the hold in place; say so on the pull request. - Release: pr-merge's scheduled step "Release eval holds whose record matches the head" (
.github/scripts/pr-merge/release-eval-hold.mjs) removesdo-not-mergeonce that record is the newest since the label went on and names the current head, and no other hold stands. A push after the record needs a new record. - AC7 is met here: each whole-page deletion carries a sensitivity-control result and each partial cut a detection-control result, in the pull request body.
Decisions
- D3: each plugin's cut is its own topic and pull request.
- Interview Q32 (D4 of the Brief): bundled defaults that pick a tool, command or library are retired wherever they appear.
- AC1's named exceptions are the kept classes of ADR 0101 (
docs/adr/0101-resolve-ecosystem-specifics-from-the-consumer-repository.md, Decision and the 2026-11-17 amendment). - Bulk-mutation standard: count first, then act; the pull request states its row count.
- The rules this item's rows fall under (rules revision 5):
- R11 (shipped knowledge): everything else that is model-read K2, K3, K4, K5 or K7. Goes through the cutting route: the generic text replaces it only at a routing site where the skill still takes a language-specific step; anywhere else it is deleted with no replacement. An item kept only because a removed item consumes it goes in the same pull request.
- R4 (consumer default): the value picks a tool or library for the consumer. Goes: no bundled default survives (ADR 0101 decision 2, "Ship no bundled default"); the choice is resolved from the consumer.
Key interfaces
- "The consumer's ecosystem (language, framework, tools): abstract now. Seam: the ecosystem-resolution contract and the consumer's own records."
- Conventions followed: a cut ships with eval evidence (the skills-and-agents review rules).
Done when
- AC1 (this plugin's share):
testingships no model-read tool, library or command choice outside the named exceptions; each listed R11 and R4 row is cut. - The pull request body states the row count (26) and lists every row id with its rule and outcome.
- Each R11 row's script-reader search is quoted in the pull request body.
- The pull request body names, for each changed skill, the existing case that reads the cut text, or says none does.
- The pull request body says, for each changed file, whether the cut deletes the whole page or part of it.
- AC10: no new enforcement-placing skill is added here.
Out of scope
- Kept rows of this plugin, and every other plugin's rows.
- Toolchain's bundled defaults (Delete toolchain's bundled ecosystem defaults #15733).
- Widening the portability gate (Annotate surviving specifics and widen the portability gate #15732).
Metadata
Metadata
Assignees
Labels
Type
Fields
Work status
Priority
Activity
melodic-automation-lanes commentedon Nov 17, 2026
Not admitted to the issue lane yet: Size large: the split into sub-issues at intake is pending (owner Q93).
melodic-automation-lanes commentedon Nov 17, 2026
The work-resolve-issue lane stopped on this issue (
split-required): the issue's Size is too large for one run, and intake's split (owner Q93) files its sub-issues.Its Size is too large for one run: intake splits it into sub-issues (owner Q93).
It set Work status to needs-triage, so the hourly triage sweep sends it back through intake triage, and it waits on no decision from a person.
Run: https://github.com/melodic-software/claude-code-plugins/actions/runs/44146032439
github-actions commentedon Nov 17, 2026
Intake triage did not triage this issue after 2 dispatches, so the sweep no longer dispatches it and set its Work status to needs-triage for a maintainer. Triage it by hand, and read the runs for why intake did not:
github-actions commentedon Nov 17, 2026
Size: Large
Complexity: Medium
Uncertainty: Known
Flags: none
Blocked by: none
Blast radius: the
testingplugin's skills, context pages, README, manifest and schema, plus stale references in CI scripts and the fence ratchet; maintainers and every consumer of that plugin read or run it.Reversible: yes; revert the pull request.
Open questions: none
Understood: cut 26 listed rows (24 R11, 2 R4) of model-read ecosystem specifics and the bundled
playwright-clidefault fromtesting, resolving the choice from the consumer. The body already gives the rows, steps and done-when, so nothing is missing. The sibling cut issues for other plugins are separate per-plugin work under the same parent (#15703), not duplicates. No merged pull request in the recent list already fixes this one.Automated triage. A maintainer reviews it.
1 remaining item
melodic-automation-lanes commentedon Nov 17, 2026
Not split at intake (owner Q93). This issue stays parked at
status: ready: no split into whole changes was found, either by task-list line or by the targets the lines name. No person is asked to act and no hold label is added. The split settings aresize-splitin.github/actions/resolve-config/admission-rules.json.Automated by the lanes App, once per reason and body version.
kyle-sexton commentedon Nov 21, 2026
Split by hand into #17740, #17741, #17743, #17744, #17754 (native sub-issues, each Small or Medium, each
eval-gated): intake sized this issue Large and its size split declinedno-split. Most of the Large rating came from the "References outside the plugin" list, which was built by bare file name and pulls in about 300 unrelated files. Each child lists only the outside references a full-pathgit grepfinds. Each child carries its rows, the rules and the host-session eval method, and closes with its own pull request. This issue's AC1 is met when every child closes by merge; the per-PR done-when lines live on the children. Row count corrected to 25 table rows plus F0449, which the table omitted; child #17743 (T3) settles F0449.