Skip to content
This repository has been archived by the owner on Feb 27, 2019. It is now read-only.

Script that can scrape the transcripts of every speech a politician has given (as long as it's been recorded on whatthefolly.com)

Notifications You must be signed in to change notification settings

andrewts129/transcript-scraping

Repository files navigation

NOTICE

It appears that whatthefolly.com has shut down as of Feb 2018, so this script will no longer work.

Script that can scrape the transcripts of every speech a politician has given (as long as it's been recorded on whatthefolly.com)

Some assembly required. The script is currently set to scrape Donald Trump's speeches. If you want to get somebody else's transcripts, you'll need to modify the variables 'tagPageUrl' and 'names'. Directions on what to change them to are given in comments in the script.

You will need to have Python 3 with the modules requests and BeautifulSoup4 installed.

Python 3: https://www.python.org/downloads/

Requests: http://docs.python-requests.org/en/master/

BeautifulSoup:https://www.crummy.com/software/BeautifulSoup/

I've also run the script for a few prominent politicans and uploaded the output here. They may be out of date, however.

About

Script that can scrape the transcripts of every speech a politician has given (as long as it's been recorded on whatthefolly.com)

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages