Apache Airflow
airflow.apache.org
What it is
Apache Airflow is a platform for authoring, scheduling, and monitoring workflows written in Python. It is designed for batch workflows with a defined beginning and end that run on a schedule. Its web application lets users manage and schedule workflows, trigger DAGs manually, inspect task status and logs, backfill runs, and rerun failed tasks. A modular architecture uses a message queue to coordinate workers and can orchestrate an arbitrary number of them. Built-in operators connect workflows to Google Cloud Platform, Amazon Web Services, Microsoft Azure, and other services. The community maintains more than 80 separately installable provider packages, which can be upgraded or downgraded independently of Airflow core. Airflow can read connections, variables, and configuration from secret backends, but those integrations do not support writes. JWT authentication is used for its public REST API and internal Execution API. From Airflow 3 onward, sensitive credentials are masked in logs, the interface, and API output. Airflow is free to download and use under the Apache License.
Spec sheet
- Purpose
- Apache Airflow is a platform for programmatically authoring, scheduling, and monitoring workflows.Read 1 Oct 2026 · airflow.apache.org
- Headquarters
- Wilmington, Delaware, U.S.Read 28 Sep 2026 · airflow.apache.org
- Founded
- 1999Read 28 Sep 2026 · airflow.apache.org
- Authentication
- Airflow uses JWT authentication for its public REST API and internal Execution API.Read 1 Oct 2026 · airflow.apache.org
- Cloud integrations
- Built-in plug-and-play operators support Google Cloud Platform, Amazon Web Services, Microsoft Azure, and other third-party services.Read 1 Oct 2026 · airflow.apache.org
- Community support
- The project provides learning resources and community support through Slack and mailing lists.Read 1 Oct 2026 · airflow.apache.org
- Deployment platforms
- Airflow officially supports Linux-based deployment environments; macOS is supported for local development and Windows is unsupported for deployment except WSL2 development.Read 1 Oct 2026 · airflow.apache.org
- Operations
- The web interface supports manually triggering DAGs, inspecting logs, monitoring task status, backfilling runs, and rerunning failed tasks.Read 1 Oct 2026 · airflow.apache.org
- Project history
- Airflow began in October 2014 at Airbnb and became an Apache Software Foundation top-level project in January 2019.Read 1 Oct 2026 · airflow.apache.org
- Provider releases
- Providers can be upgraded or downgraded independently of the Airflow core release.Read 1 Oct 2026 · airflow.apache.org
- Providers
- The community maintains more than 80 separately installable provider packages.Read 1 Oct 2026 · airflow.apache.org
- Scalability
- Its modular architecture uses a message queue to orchestrate an arbitrary number of workers.Read 1 Oct 2026 · airflow.apache.org
- Secrets
- Airflow can read connections, variables, and configuration from secret backends instead of its database, but secret-backend integrations do not allow writes.Read 1 Oct 2026 · airflow.apache.org
- Sensitive data
- In Airflow 3 and later, sensitive credentials are masked in logs, the UI, and API outputs.Read 1 Oct 2026 · airflow.apache.org
- Web interface
- Its web application lets users monitor, schedule, and manage workflows and view task status and logs.Read 1 Oct 2026 · airflow.apache.org
- Workflow fit
- Airflow is intended for batch workflows with a clear start and end that run on a schedule.Read 1 Oct 2026 · airflow.apache.org
- Workflow language
- Airflow workflows are defined in Python code.Read 1 Oct 2026 · airflow.apache.org
Plans and prices
Strong points and limits
Strong points
- Free to download and use under the Apache License.
- Web interface supports logs, backfills, and reruns.
- More than 80 community provider packages are available.
- Provider packages can change independently of Airflow core.
- Sensitive credentials are masked from Airflow 3 onward.
Limits
- Workflows are defined in Python code.
- Secret-backend integrations do not allow writes.
- Windows is unsupported for deployment except WSL2 development.
Who it suits
Airflow suits teams with scheduled batch workflows they want to define in Python and operate through a web interface. It is intended for self-hosted deployment in Linux-based environments; macOS is supported for local development, while Windows is limited to WSL2 development.
Verdict
Airflow provides detailed workflow operations, a broad operator ecosystem, and worker coordination for scheduled batch work. Consider its Python workflow model and Linux deployment requirement when deciding whether it fits.
Where Specifiction places it
- Workload Automation Software#4 of 248.6
- Workflow Orchestration Software#8 of 388.6
- DataOps Platforms#5 of 168.6