Skip to content

fix(llms): separate spec rules from safety limits - #60

Merged
iannuttall merged 1 commit into
mainfrom
feature/audit-llms-txt-limits
Aug 17, 2026
Merged

iannuttall merged 1 commit into
mainfrom
feature/audit-llms-txt-limits

Conversation

@iannuttall

Copy link
Copy Markdown
Owner

Summary

  • The root cause was three local safety values presented as llms.txt v2 rules; this removes the 100-link, 100 KB, and 12-section conformance claims.
  • Link checks, body reads, and agent output remain bounded, with partial or capped provenance; generation now defaults to 250 URLs and supports up to 10,000 crawl URLs.
  • Regression tests cover valid large files, partial link checks, the 2 MB body limit, repeat-fetch failure, and MCP input bounds.
  • Validation passed with build, typecheck, test, lint, the CLI help sweep, package dry-run, and a 10,000-page resource fixture.

Remove unsupported link, byte, and section limits from llms.txt validation. Keep acquisition and agent output bounded, and report capped checks as partial evidence.
@iannuttall
iannuttall marked this pull request as ready for review August 17, 2026 08:24
@iannuttall
iannuttall merged commit 292a3b7 into main Aug 17, 2026
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant