Get startedSign in

Installing Airflow

Open-source workflow management system that allows data engineers to orchestrate sequenceable tasks.

Description

Plural will install Airflow in a dependency-aware manner onto a Plural-managed Kubernetes cluster with one CLI command.

Installation

We currently support Airflow for the following providers:

plural bundle install airflow airflow-aws

Setup Configuration

  • airflowBucket: Arbitrary bucket name to store the logs in
  • hostname: Fully Qualified Domain Name to use for your airflow installation, eg airflow.topleveldomain.com if topleveldomain.com is the domain you inputed for dns_domain above.
  • dagRepo: Git Repo url for storing dags, can be either an https or ssh url
  • gitUser: git username for git sync to download the dag repo, eg your github username
  • gitAccessToken: github/gitlab access token to use for http git authentication
  • private_key: path to the private key to use for git authentication
  • passphrase: passphrase to use for encrypted private keys (leave empty if not applicable)
  • branchName: The branch to sync from
  • adminUsername: The airflow username for the admin
  • adminFirst: The first name for the admin
  • adminLast: The last name for the admin
  • adminEmail: The email for the admin