Headless MCP server for Screaming Frog SEO Spider – run crawls, export and analyze crawl data via the CLI. Small locked-down tool surface for scheduled audits, CI, and unattended AI agents.
-
Updated
Aug 31, 2026 - Python
Headless MCP server for Screaming Frog SEO Spider – run crawls, export and analyze crawl data via the CLI. Small locked-down tool surface for scheduled audits, CI, and unattended AI agents.
Uses Screaming Frog Internal HTML with text extraction along with a shingling algorithm to compare content duplication across the pages of a crawled site.
A custom JavaScript extraction that uses Google's Gemini AI to analyze how your content performs in Google's AI Mode search by predicting query fan-out patterns.
R integration with Screaming Frog CLI
Config files to run Screaming Frog on Google Cloud Platform and export crawls and extracted data to BigQuery
Drive the Screaming Frog SEO Spider from Claude, Cursor, or any MCP client: headless crawls, a ranked issue register, derived analysis and a shareable report. Works on the free tier.
Screaming Frog Custom Javascript Integration with OpenAI, create visual fan out queries from your page.
Find online, real web results for backlink opportunities with Screaming Frog using AI
I built a MuVeRA-inspired content analyzer for SEO after working on Google's research on multi-vector retrieval
🕷️ Onwebs SEO & GEO — the complete FREE & open-source Screaming Frog alternative. Unlimited desktop SEO crawler + GEO/AI-search toolkit (Rust/Tauri). جایگزین رایگان Screaming Frog — کاملترین ابزار سئو رایگان
Repo for RustySEO Releases, A FREE SE0/GEO Toolkit
Open source alternative to Screaming Frog SEO Spider — LLM-native, MCP server included, 269 rules, DuckDB+Parquet storage, MIT licensed.
Turn a Screaming Frog crawl into role-specific, prioritised action plans that people without SEO knowledge can actually execute.
MCP server for Screaming Frog SEO Spider — headless crawls, data export, and a technical SEO scan skill for Claude. Patched for cross-platform support (Mac + Windows).
Tool for converting SFCC eCDN-WAF log to standard log formats like W3C
Les outils de maillage interne triés sur une seule question vérifiable : qui écrit le lien dans le HTML servi, et où ce lien vit.
Claude Code skill that wraps ScreamingFrog: headless crawls, Derby DB queries, crawl diffs, and HTML audit reports.
SEO evidence toolkit: analyzes Screaming Frog exports, adds bounded live and infrastructure checks, and produces structured audits, task backlogs, and reports via CLI and local MCP.
Example CSV output file: https://pa11y-screaming-frog.pages.dev/pa11y_results.csv
WebAtlas is a Python-based technical SEO tool that transforms flat Screaming Frog Excel exports into dynamic, interactive network graphs. It allows SEOs to visualize internal linking structures, identify crawl depth issues, and discover topical silos that are invisible in standard spreadsheets.
To associate your repository with the screaming-frog topic, visit your repo's landing page and select "manage topics."