This is an Astro CLI project used to show Cosmos examples.
Ensure you have the Astro CLI >= 1.8.0 installed
Run astro dev start to start the project. By default, this runs against the Airflow metadata database. To reset the database, run astro dev kill and then astro dev start.
This repo comes with a few examples located in the dags/ directory. These are meant to be used as a reference for how to use the various features of Cosmos.
This DAG demonstrates a simple example of running the dbt jaffle shop project using Cosmos. It uses a virtual environment for the dbt commands, which is created in the Dockerfile and used in the DbtTaskGroup.
This DAG demonstrates an example of filtering/selecting models instead of using all models in a project. In this case, we've filtered down to tags:customer, and there are two models with this tag:
stg_customerscustomers
The stg_customers tag is defined in dags/dbt/jaffle_shop/models/staging/schema.yml using a config file. The customers tag is defined directly in the model SQL, located in dags/dbt/jaffle_shop/models/customers.sql.