Skip to content

About

Open SEO crawl export format: JSON Schema and CSV column reference for site crawl data, with a real sample export and a validator script

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Repository files navigation

crawlcove-export-spec

The JSON Schema and CSV column reference for Crawl Cove's SEO crawl export — validate, script against, or build integrations on top of a Crawl Cove crawl export without reverse-engineering it.

What's here

  • schema/crawl-export.schema.json — a JSON Schema (2020-12) for the full-crawl JSON export the desktop app produces from its Reports page.
  • docs/csv-columns.md — the column reference for the equivalent CSV export, including exactly how it differs from JSON (booleans, nulls, formula-injection escaping).
  • docs/versioning.md — how the schemaVersion field changes, and what counts as a breaking change.
  • examples/sample-crawl-export.json — a real export, produced by the app's own export code against a small seeded crawl, not hand-written JSON.
  • scripts/validate.js — a small Ajv-based validator you can point at your own export.

Install & validate

git clone https://github.com/CrawlCove/seo-crawl-export-spec.git
cd crawlcove-export-spec
npm install
npm run validate -- path/to/your-export.json   # or omit the path to check the bundled sample

Using the schema in your own tools

const Ajv = require('ajv')
const addFormats = require('ajv-formats')
const schema = require('crawlcove-export-spec/schema/crawl-export.schema.json')

const ajv = new Ajv()
addFormats(ajv)
const validate = ajv.compile(schema)
validate(myExport) // false + validate.errors on mismatch

Works with CrawlCove

This is the export format produced by Crawl Cove, a desktop SEO crawler for Windows and Mac. Run a crawl, export the Reports page to JSON or CSV, and validate it here — or build against the schema directly if you're consuming exports programmatically.

This repo has its own page on crawlcove.com: Crawl Cove export spec, with the post on the crawl export format at https://crawlcove.com/blog/seo-crawl-export-format.

Related tools

  • crawlcove-js — crawlcove-export, a typed JavaScript/TypeScript library to load, query and convert Crawl Cove exports.
  • crawlcove-sheets — Google Sheets add-on that turns a Crawl Cove export into an audit workbook (issues by type, pages by status, title/meta flags).
  • crawlcove-sf-import — convert a Screaming Frog export into the Crawl Cove export format, with a report of what carried over.
  • crawlcove-schema-validator — validate a page's JSON-LD against Google's required and recommended rich-result properties.
  • crawlcove-hreflang-checker — check a page's or a sitemap's hreflang tags: codes, self-reference, x-default and return tags.
  • crawlcove-mcp — MCP server that gives Claude, Cursor and other AI assistants the crawl data: crawl a site, list issues, find broken links.
  • crawlcove-cli — command line SEO crawler for scripts and CI; its per-page output uses this spec's field names where it checks the same thing.
  • crawlcove-connector — WordPress plugin that applies Crawl Cove's approved fixes to Yoast, Rank Math, SEOPress, or AIOSEO.
  • crawlcove-redirect-chain-checker — follow every hop of a URL’s redirects; flags chains, loops, HTTPS downgrades and meta refreshes.
  • crawlcove-sitemap-validator — validate an XML sitemap or sitemap index against the protocol and search-engine limits.
  • crawlcove-robots-txt-tester — lint a robots.txt and test which URLs each crawler may fetch, with the deciding line.

License

MIT — see LICENSE.

About

Open SEO crawl export format: JSON Schema and CSV column reference for site crawl data, with a real sample export and a validator script

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages