Code

Simplify/improve several DAGs#75

Code

Merged

hammerhead merged 7 commits intomaincrate/cratedb-airflow-tutorial:mainfrom hammerhead/data-retention-5.2crate/cratedb-airflow-tutorial:hammerhead/data-retention-5.2Copy head branch name to clipboardJan 13, 2023

+116-136

Commits

Commits on Dec 22, 2022

• Adjust data retention reallocate strategy to use CrateDB 5.2 node attributes

  hammerhead

  committed
  cf82c2a

  Copy full SHA for cf82c2a

• Update development dependencies

  hammerhead

  committed
  8e048d6

  Copy full SHA for 8e048d6

Commits on Dec 27, 2022

• Simplify data retention DAGs by using dynamic task mapping on the params parameter

  Show description for ec7355b
  hammerhead

  committed
  ec7355b

  Copy full SHA for ec7355b

• Simplify bash commands by using env parameter

  hammerhead

  committed
  2adc518

  Copy full SHA for 2adc518

• Use dynamic task mapping for SQL generation in Data Quality DAG

  hammerhead

  committed
  337ef74

  Copy full SHA for 337ef74

• Define a primary key on all tables (except for staging tables)

  hammerhead

  committed
  a8fe45c

  Copy full SHA for a8fe45c

• Add explicit pendulum dependency

  hammerhead

  committed
  b0dcd0e

  Copy full SHA for b0dcd0e