基于Scrapy框架的异步爬虫, 在没有挂载代理ip服务器的情况下, 需要在 setting.py 中把速度降低, 否则会被封IP.
通过 run.bat 可以直接运行, 爬虫会抓取 名称, 众筹进度, 筹款金额, 剩余时间, 点赞人数, 如果需要抓取别的, 可以在 jdzc_spider.py 中添加路径.
-
Notifications
You must be signed in to change notification settings - Fork 0
京东众筹异步爬虫
License
ruicx/Jingdong-Crowdfunding
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
京东众筹异步爬虫
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published