Skip to main content
Automation

Self-host Apache Airflow on a VPS

Programmatic workflow scheduling and orchestration.

Define data pipelines as code with scheduling, retries and rich monitoring.

Why self-host Apache Airflow?

Airflow is the standard for data and batch orchestration, and self-hosting keeps your pipelines and data in-house.

How to install Apache Airflow

  1. 1

    Provision a VPS

    Choose a plan with room for your data as well as the app.

  2. 2

    Install the stack

    Install Python + scheduler + Postgres/Redis.

  3. 3

    Deploy the application

    Follow the project’s official install guide for your distribution.

  4. 4

    Enable HTTPS

    Serve it on your own domain behind a reverse proxy with a certificate.

  5. 5

    Back it up

    Schedule a database dump plus a copy of any uploaded files to an off-box location.

Practical tips

  • Give Apache Airflow its own database user with rights only on its own schema.
  • Reverse-proxy Apache Airflow and terminate TLS at the proxy so certificates are managed in one place.
  • Take a VPS snapshot before major upgrades so you can roll back cleanly.
  • Keep Apache Airflow patched — most self-hosting incidents are unpatched software.

Frequently asked questions

How much RAM does Apache Airflow need?
Plan on 4 GB for typical use; add headroom if you expect many concurrent users.
What stack does Apache Airflow run on?
Python + scheduler + Postgres/Redis.
Can I run other things on the same VPS?
Yes — size the plan so Apache Airflow plus your other workloads fit in RAM with room to spare.

Looking for something else? Popular alternatives include Windmill, Dagster, Prefect — browse all app guides.