crawler-checker

Here are 2 public repositories matching this topic...

Production indexability and AI crawler monitoring CLI plus GitHub Action: noindex, canonical, robots.txt, and optional edge checks.

Homebrew tap for the ActableSite indexability and AI crawler policy CLI.

cli homebrew seo robots-txt openai homebrew-tap noindex claude canonical perplexity technical-seo ai-crawler chatgpt anthropic ai-seo crawler-checker

Add a description, image, and links to the crawler-checker topic page so that developers can more easily learn about it.

To associate your repository with the crawler-checker topic, visit your repo's landing page and select "manage topics."