Skip to content

stephenpaulger/change.org_scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 

Repository files navigation

change.org petition scraper

Scrapy based scraper for change.org that scrapes results for a search term.

Installation

Python 3 and scrapy are the only dependencies, once you have Python installed you can install scrapy using.

pip install scrapy==2.0.1

Running

In the directory where you've cloned this repository.

scrapy crawl petitions -a search="search term" -o petitions.json

This will create a JSON file with data about all of the results matching the "search term" search. If you want the result in csv replace petitions.json with petitions.csv.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages