一个基于scrapy框架编写的马蜂窝用户旅游路线爬虫，核心代码不到50行！
一天成功爬取25万用户足迹~
使用方法:
$pip install -r requirements.txt
$scrapy crawl path -o dests.jsonPS: 虽然马蜂窝还在很辣鸡地使用http，还是不要过于密集地爬取，象征性地给服务器0.1s的休息时间
-
Notifications
You must be signed in to change notification settings - Fork 24
eternal-flame-AD/mafengwo
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
一个基于scrapy框架编写的马蜂窝旅游网用户旅游路线爬虫，核心代码不到50行！
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published