Skip to content
This repository has been archived by the owner on Oct 11, 2021. It is now read-only.

Decisive Dice
Compare
Choose a tag to compare
@villasv villasv released this 14 Nov 22:00
· 85 commits to master since this release
v4
526c90b

The fourth official release focuses on a more mature cloud architecture following AWS recommendations for CloudFormation templates.

New features:

  • Multi-AZ ASG for the Airflow EC2 instances, towards fault tolerance
  • Split template into nested stacks allowing deployment on existing VPCs
  • Store the Fernet key in the AWS Parameter Store instead of EBS

Stack improvements

  • Removed hardcoded bucket names and trust CFN to create them
  • Removed tenacity version pin for py3.7 because it was fixed on airflow
  • Removed celery version pin for thread safety because it was fixed on airflow
  • Changed default mininum worker count to 1, a more sensible default for demos
  • Multiple improvements targeting compliance with AWS QuickStart guidelines

Fixes:

  • Added cfn-signal missing relevant parameters
  • Removed hardcoded AZ options that failed in specific regions
  • Added EFS mount to fstab guaranteeing it's there after a reboot

Misc:

  • Upgraded to apache-airflow==1.10.6
  • Added cfn-lint as GitHub Action
  • Automated testing with taskcat
  • Merged on upstream Airflow a higher limit for queue names
Assets 2
Loading