Crawlerdex - 2026-05-31 04:11 UTC

Automated release from 6b89900.

• crawlers.json: full crawler database
• crawlers.min.json: minified, no instances or addition_date
• crawler-stats.json: per-crawler aggregated block-rate stats
• crawler-block-percentages.json: block-rate time series
• domain-crawler-blocks.json: per-domain crawler allow/block map

Crawlerdex - 2026-05-30 03:26 UTC

Automated release from 6b89900.

• crawlers.json: full crawler database
• crawlers.min.json: minified, no instances or addition_date
• crawler-stats.json: per-crawler aggregated block-rate stats
• crawler-block-percentages.json: block-rate time series
• domain-crawler-blocks.json: per-domain crawler allow/block map

Crawlerdex - 2026-05-29 04:01 UTC

Automated release from 6b89900.

• crawlers.json: full crawler database
• crawlers.min.json: minified, no instances or addition_date
• crawler-stats.json: per-crawler aggregated block-rate stats
• crawler-block-percentages.json: block-rate time series
• domain-crawler-blocks.json: per-domain crawler allow/block map

Crawlerdex - 2026-05-28 03:29 UTC

Automated release from 6b89900.

• crawlers.json: full crawler database
• crawlers.min.json: minified, no instances or addition_date
• crawler-stats.json: per-crawler aggregated block-rate stats
• crawler-block-percentages.json: block-rate time series
• domain-crawler-blocks.json: per-domain crawler allow/block map

Crawlerdex - 2026-05-27 04:11 UTC

Automated release from 6b89900.

• crawlers.json: full crawler database
• crawlers.min.json: minified, no instances or addition_date
• crawler-stats.json: per-crawler aggregated block-rate stats
• crawler-block-percentages.json: block-rate time series
• domain-crawler-blocks.json: per-domain crawler allow/block map

Crawlerdex - 2026-05-26 03:31 UTC

Automated release from 6b89900.

• crawlers.json: full crawler database
• crawlers.min.json: minified, no instances or addition_date
• crawler-stats.json: per-crawler aggregated block-rate stats
• crawler-block-percentages.json: block-rate time series
• domain-crawler-blocks.json: per-domain crawler allow/block map