A web scraper to get listings from popular vintage and pre-owned watch retailers.
- Scrape hundreds of listings from different vintage and pre-owned watch retail sites
- Faster scraping with multithreading
- Get listings by site
- Search for listings containing a search term
- Sort listings by price (low to high)
- Download images from listings
- Open listings in-browser
- Theo and Harris: https://theoandharris.com/vintage-watches/
- Delray Watch: https://www.delraywatch.com/collections/pre-owned-watches/
- Omega Enthusiast: https://www.omegaenthusiastltd.com/shop-all/
Clone/Download the GitHub repository:
git clone https://github.com/christopherlam888/chrono-crawler.git
Navigate to the directory:
cd chrono-crawler
Install requirements:
pip3 install -r requirements.txt
Chrono Crawler uses Selenium with the Chrome WebDriver. Install Chrome/Chromium before using.
| Command | Description |
|---|---|
python3 -m chrono_crawler |
Run Chrono Crawler with defaults (all sites) |
python3 -m chrono_crawler -t |
Get listings from Theo and Harris |
python3 -m chrono_crawler -d |
Get listings from Delray Watch |
python3 -m chrono_crawler -o |
Get listings from Omega Enthusiast |
python3 -m chrono_crawler -s [search] |
Search for listings containing a search term |
python3 -m chrono_crawler -p |
Sort listings by price (low to high) |
python3 -m chrono_crawler -i |
Download images from listings |
python3 -m chrono_crawler -h |
Show help message |
- Code cleanup
- Add more websites
- Add more tests
This project is licensed under the GNU General Public License v3.0.