Python 3.4 Asyncio Based Crawler
- git clone https://github.com/technomaniac/asyncrawl.git
- cd asyncrawl
- pip3 install -r requirements.txt
- python crawl.py -u "url" -c "max_tasks" -f "out csv file"
technomaniac/asyncrawl
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|