Skip to content

Ambari stack service for installing and managing Apache Airflow on HDP cluster

License

Notifications You must be signed in to change notification settings

Couture-ai/ambari-airflow-mpack

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

35 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

airflow-ambari-mpack

Apache Airflow mpack for ambari. Mpack allows you to install/configure airflow directly from ambari.

Apache Airflow version included: 1.9.0

Installing Apache Aiflow Mpack:

  1. Stop Ambari server.
  2. Install the Apache Airflow Mpack on Ambari server.
  3. Start Ambari server.
ambari-server stop
ambari-server install-mpack --mpack=airflow-service-mpack.tar.gz
ambari-server start

Upgrading Apache Aiflow Mpack:

  1. Stop Ambari server.
  2. Upgrade the Apache Airflow Mpack on Ambari server.
  3. Start Ambari server.
ambari-server stop
ambari-server upgrade-mpack --mpack=airflow-service-mpack.tar.gz
ambari-server start

Installing Apache Airflow from Ambari:

  1. Action - Add service.
  2. Select Apache Airflow service.
  3. Choose destination server.
  4. You may configure Apache Airflow, change home folder.
  5. Deploy!

Add service Select Apache Airflow service Choose destination server Choose destination server configure Apache Airflow Deploy Deploy Deploy Deploy Deploy

Virtual environment support

If you want to run apache airflow in virtual environment, you should modify startup script "AIRFLOW_HOME/airflow_control.sh".

Example:

#!/bin/bash

export AIRFLOW_HOME=/usr/local/airflow/airflow/ && source /usr/local/airflow/airflow_venv/airflow/bin/activate && /usr/local/airflow/airflow_venv/airflow/bin/airflow $1 --pid /usr/local/airflow/airflow/airflow-sys-$1.pid

Enjoy!

About

Ambari stack service for installing and managing Apache Airflow on HDP cluster

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%