Skip to content

Retire description/late-instruction - #82

Merged
niksa90 merged 2 commits into
mainfrom
claude/loving-ritchie-4clta3
Nov 18, 2026
Merged

niksa90 merged 2 commits into
mainfrom
claude/loving-ritchie-4clta3

Conversation

@niksa90

@niksa90 niksa90 commented Nov 18, 2026 •

Copy link
Copy Markdown
Owner

What

  • Removes the description/late-instruction rule (src/rules/description.ts, src/rules/index.ts).
  • RETIRED_RULES (in src/rules/index.ts) replaces RULE_ALIASES, whose one entry was this rule. toolmenu explain description/late-instruction (and explain_rule) says it was retired and why; a config that names it loads, with a stderr line saying the setting changes nothing.
  • description/buried is unchanged: it checks Claude Code's cuts, the amazon-q preset, or the descriptionLimit a user sets (descriptionLimit: 280 still works for a client that cuts there).
  • Rows removed from docs/RULES.md and docs/snapshot.md; docs/SPEC.md keeps its frozen table with a dated note; docs/PROTOCOLS.md regenerated; CHANGELOG under Unreleased.

Why

The rule flagged instructions past character 280, which no client documents. The number came from one private client (FINDINGS, "Buried routing instructions"). On every client toolmenu has a cut for, the finding ended with "so there they arrive". It was the one note on serbia-prices-mcp 0.1.5, and on Firecrawl and Supabase in the golden set.

Tests

npm test: 727 passing. The rule's three tests are replaced by one that checks an instruction at character 440 says nothing and that descriptionLimit: 280 still gets description/buried. New: explain on the retired id, in text and JSON, and a config naming it loads with the line on stderr. The golden findings lose their two late-instruction lines.

It flagged instructions past character 280, a cut no client documents:
the number came from one private client. The documented cuts (Claude
Code 16,384 and 4,096, Amazon Q CLI 10,024) are description/buried's,
as is any descriptionLimit a user sets. A config naming the old id is
accepted and changes nothing.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014kCPJZAgTv3Bna4BGLzw2o
@github-actions

Copy link
Copy Markdown

toolmenu

Verdict: ✓ unchanged: the same menu and the same findings. Nothing to accept. Findings against the baseline: 0 new, 0 gone, 0 changed.

toolmenu diff: toolmenu 0.28.0 → 0.28.1 (server-reported)

No breaking changes · 0 minor · 0 notices · ±0 tokens (~1,523 → ~1,523, estimate) · 6 → 6 tools

Version: suggested bump: none · not checked (set the Action's release input old..new)

No findings.

✓ 0 errors, 0 warnings, 0 info

Baseline: docs/toolmenu-menu.json as of main

toolmenu snapshot: toolmenu 0.28.1

Protocol 2026-07-28 · 6 tools · ~1,523 tokens (estimate)

1 info
Rule Finding
info write/no-dry-run · unsure 2 tools are annotated as destructive, and toolmenu found no dry_run/preview-style parameter and no preview tool for the same thing. Where a mistake is costly to undo, a dry run lets the agent see what would change while it can still back out. · snapshot_menu, check_session
→ Next: Where the effect is hard to undo, add a dry_run parameter that returns what would change without changing it. If it's cheap to undo, or a preview exists under another name, ignore this.

0 errors, 0 warnings, 1 info

Where the tokens go (estimate): the top 5 tools are 93% of the menu
Share Tool Tokens Description Schema
30% snapshot_menu ~461 ~99 ~353
26% check_session ~394 ~102 ~283
15% review_baseline ~231 ~65 ~156
12% diff_menus ~187 ~39 ~138
10% check_auth ~149 ~86 ~54
  • repeated: cwd (~37 tokens) in 4 tools, ~148 in all

A tool's schema can't $ref another tool's, so a block shared across tools is paid once per tool: only a smaller block saves tokens there.

toolmenu · token counts are estimates

- RETIRED_RULES replaces RULE_ALIASES, which had no entries left.
  toolmenu explain on a retired id says it was retired and why; a config
  that names one loads, with a line saying the setting changes nothing.
- docs/SPEC.md is frozen: its row stays, with a dated note.
- CHANGELOG: Amazon Q's 10,024 is reported, not documented.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014kCPJZAgTv3Bna4BGLzw2o
@niksa90
niksa90 merged commit 62d1a48 into main Nov 18, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants