Tutorial on Extracting data from twitter and feed it to Postgres after doing Sentimental Analysis and packaging it into docker
This tutorial is intended for self learning and making use of Twitter client authentication and consumer token(compatible with ver 2 and 1.1 respectively)
- Install Docker Desktop.
- VSC/Any other interpreter.
- Dockerhub Account was created and Docker desktop installed(Windows)
- Twitter Developer account with Elevated Access and necessary tokens generated.
collect_tweet_stream.py
extracts the tweetsapp/db
,app/writers
folder contains python scripts that interacts with Postgres tables- Adminer to view the data getting ingested
VADER
analyses the sentiment
- Make changes in the
credentials.json
to add the Twitter credentials. - Add the keyword to be searched in Tweets
collect_tweets_stream.py
at line 25
Access the Adminer link- http://localhost:8080/?pgsql=db to watch the rows getting added.