Repository navigation

search_spider

Public

About

No description, website, or topics provided.

1 star

1 watching

Report repository

Name		Name	Last commit message	Last commit date
tutorial		tutorial
.gitignore		.gitignore
README.md		README.md
docker-compose.yml		docker-compose.yml
dockerfile		dockerfile
main.py		main.py
requirements.txt		requirements.txt
scrapy.cfg		scrapy.cfg

Repository files navigation

search_spider

1. 技术栈

python2.7
scrapy
mongodb
redis
elasticsearch

2.功能

果壳网爬虫
豆瓣网爬虫
知乎日报爬虫
吉尼斯官网爬虫（采用docker和scrapy-redis实现了分布式）

search_spider

About

No description, website, or topics provided.

1 star

1 watching

Report repository

Releases

Packages

Contributors

Languages