Skip to content

Keep only safety-invariant checks among the guide-wording contract tests #5048

Description

@devantler

Why

39 .claude/scripts/*.test.sh files (~17.5k lines) test no script; they assert exact sentences in AGENTS.md and the guides. 197 of 238 commits that edited a guide in 60 days also had to edit a test, so most wording changes are two-file PRs, and each test has its own CI job.

What

  • Keep structural checks: the AGENTS.md size cap and the guide-index check.
  • Replace the remaining safety-relevant pins with one small presence test for the non-negotiables (trusted author logins, never --admin, the egress and privacy rules, the model restriction, the AI-disclosure line). Agents can edit their own guides, so a tripwire on those rules is worth keeping.
  • Delete the other wording pins and their CI jobs.

What is lost

Notice when a non-safety sentence is reworded. Review covers that.

First step

Classify the 39 files into keep, fold-into-presence-test and delete, then remove the delete group in one PR.

Part of #5047.

🤖 Generated with Claude Code

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Fields

    No fields configured for Refactor.

    Projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions