All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.
- Portable Package Export: Download scrapers as ZIP files (
/downloadendpoint). - Auto-Dependency Management: Generated scrapers now include PEP 723 metadata for
uv runsupport and a fallbackvenvsetup. - Task Scheduler Integration:
setup_task.batand PowerShell script to register daily scraper tasks on Windows. - PTT Gossiping Support: Updated default example to handle landing pages like PTT.
- Filename Parsing: Frontend now correctly extracts dynamic filenames from headers.
- UI Overhaul: Migrated to a professional dark theme.
- README: Rewritten to focus on engineering workflow and architecture.
- Sandbox: Enhanced import security whitelist (e.g.,
urllib.parsesubmodules).
- Batch Script Syntax: Fixed
run.batcrashing due to parenthesis parsing inechocommands. - Download Filename: Fixed issue where downloads had UUID filenames without extensions.
- Initial release of SmartScraper.
- AI-powered visual analysis of webpages (Playwright + GPT-Vision).
- Code generation using OpenAI Codex.
- Secure Sandbox execution environment.
- Auto-Fix loop for refining scraper code.