An Apache Airflow stack for docker, orchestrated using docker-compose. pgAdmin is included to easily view and manage Airflow's meta database.

NOTE: I put this together to learn docker. As such, I wouldn't recommend using it in production as is.

Set the following environment variables:

• AIRFLOW_DOCKER_PASSWORD - use anywhere a password is required: postgres, pgadmin, Airflow webserver, etc...
• AIRFLOW_DOCKER_EMAIL - use as the email for the default pgaAdmin and Airflow admin user.

To start the containers with just a minial installation (Airflow Core), run: docker-compose up -d.

To install extra Airflow packages, you'll need to first build the image, specifying the extras build arg. Additional build args can be found below.

1. docker-compose build --build-arg extras=ssh,microsoft.mssql,http
2. docker-compose up -d

The Airflow scheduler and webserver each have their own container (define in airflow-common). The airflow directory is mounted in the containers as AIRFLOW_HOME at /opt/airflow.

These build args can be specified when building images for the Airflow containers.

The following images are used:

• PostgreSQL
• Apache Airflow
• pgAdmin