This repository shows concepts and DAGs which connect to a Postgres database. The DAGs automate the ingestion of data from two third-party APIs, and the creation of tables with PostgresOperator, queries to the database with PostgresHook, execution of Python functions with PythonOperator, as well as execution of Bash commands with BashOperator. The airflow was containerized with Docker.
-
Notifications
You must be signed in to change notification settings - Fork 0
This repository shows concepts and DAGs which connect to a Postgres database. The DAGs automate the ingestion of data from two third-party APIs, and the creation of tables with PostgresOperator, queries to the database with PostgresHook, execution of Python functions with PythonOperator, as well as execution of Bash commands with BashOperator. T…
License
BrandonSmith710/Spotify_Weather_Airflow
About
This repository shows concepts and DAGs which connect to a Postgres database. The DAGs automate the ingestion of data from two third-party APIs, and the creation of tables with PostgresOperator, queries to the database with PostgresHook, execution of Python functions with PythonOperator, as well as execution of Bash commands with BashOperator. T…
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published