Skip to content

README.md

Latest commit

 

History

History
72 lines (51 loc) · 2 KB

README.md

File metadata and controls

72 lines (51 loc) · 2 KB

ScrapeKit

Fast, flexible web scraping toolkit. Extract structured data from any website in seconds.

Python License Version

Features

Feature Free Premium
Scrape static pages Yes Yes
CSV output Yes Yes
Auto-detect page structure Yes Yes
Up to 100 records Yes Yes
Unlimited records - Yes
JSON & Excel export - Yes
Dynamic JS pages (Playwright) - Yes
Custom CSS selectors - Yes
Multi-URL batch scraping - Yes

30-day free trial includes all Premium features.

Install

pip install requests beautifulsoup4 lxml
# Optional for JS-heavy sites:
pip install playwright && playwright install chromium

Quick Start

# Scrape product listings
python scrapekit.py --url "https://books.toscrape.com" --output books.csv

# Extract all links
python scrapekit.py --url "https://example.com" --mode links --format json

# Scrape tables
python scrapekit.py --url "https://example.com/data" --mode tables -o data.csv

# JS-rendered pages (Premium)
python scrapekit.py --url "https://spa-app.com" --dynamic -o results.json

Extraction Modes

  • auto - Auto-detects structured content, falls back to text (default)
  • structured - Extracts repeating items (products, cards, listings)
  • links - Extracts all links with text
  • tables - Extracts HTML tables
  • text - Extracts text blocks from headings and paragraphs

Output Formats

  • CSV (default) - spreadsheet-ready
  • JSON - for APIs and developers
  • Excel - .xlsx with formatting (Premium)

Activate Premium

python scrapekit.py --activate YOUR-LICENSE-KEY

Get your key at tirandev.gumroad.com

License

MIT License - free for personal and commercial use. Premium features require a license key after the 30-day trial.