Skip to content

Quick Docker Compose deployment for Apache Airflow version 2.x. Ideal for local development

Notifications You must be signed in to change notification settings

resdevd/docker-compose-airflow

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

docker-compose-airflow

Note: Updated to Airflow version 2.2.0

Docker Compose Apache Airflow (Official Docker Images) with CeleryExecutor, InitDB and InitUser

Ideal for local development or small scale personal deployments.

Features

  • Add any linux packages and/or python libraries to the image.
  • Easy deployment in minutes.

How to deploy:

Prerequisite: Docker and docker-compose to be installed.

Step 1: Clone this Repo and open terminal.

Step 2: Go through .env file, init_airflow_setup.sh, docker-compose.yml file to change settings according to your preference. Or you can just keep them as it is for local development.

Step 3: Run docker-compose up -d

Step 4: Run sh init_airflow_setup.sh (Run this only for initial deployment)

Step 5: Go to http://localhost:8080 and login with user: airflow_test_user and password: airflow_test_password as specified in init_airflow_setup.sh script

Step 6: Run few dags and monitor Celery workers at http://localhost:5555