Skip to content

Latest commit

 

History

History
66 lines (50 loc) · 3 KB

README.md

File metadata and controls

66 lines (50 loc) · 3 KB
Raw

Helm Chart for Apache Airflow

Artifact HUB

Apache Airflow is a platform to programmatically author, schedule and monitor workflows.

Introduction

This chart will bootstrap an Airflow deployment on a Kubernetes cluster using the Helm package manager.

Requirements

  • Kubernetes 1.26+ cluster
  • Helm 3.0+
  • PV provisioner support in the underlying infrastructure (optionally)

Features

  • Supported executors: LocalExecutor, CeleryExecutor, KubernetesExecutor, LocalKubernetesExecutor, CeleryKubernetesExecutor
  • Supported AWS executors with AWS provider version 8.21.0+:
    • airflow.providers.amazon.aws.executors.batch.AwsBatchExecutor
    • airflow.providers.amazon.aws.executors.ecs.AwsEcsExecutor
  • Supported Airflow version: 1.10+, 2.0+
  • Supported database backend: PostgreSQL, MySQL
  • Autoscaling for CeleryExecutor provided by KEDA
  • PostgreSQL and PgBouncer with a battle-tested configuration
  • Monitoring:
    • StatsD/Prometheus metrics for Airflow
    • Prometheus metrics for PgBouncer
    • Flower
  • Automatic database migration after a new deployment
  • Administrator account creation during deployment
  • Kerberos secure configuration
  • One-command deployment for any type of executor. You don't need to provide other services e.g. Redis/Database to test the Airflow.

Documentation

Full documentation for Helm Chart (latest stable release) lives on the website.

Note: If you're looking for documentation for main branch (latest development branch): you can find it on s.apache.org/airflow-docs/. Source code for documentation is in ../docs/helm-chart

Contributing

Want to help build Apache Airflow? Check out our contributing documentation.