Skip to content
SPECIFICTION
Get listed

Apache Airflow vs dagster-slurm

Apache Airflow

airflow.apache.org

dagster-slurm

dagster-slurm.geoheil.com

Side by side

FigureApache Airflowdagster-slurm
Price fromFreeFree
Free planYesYes
Free trial——
Open source——
WebYes—
macOSYesYes
LinuxYesYes
APIYesYes
Self-hostedYesYes
Plans published11
Spec score · Workflow Orchestration Software8.6 (#8)7.9 (#20)
PurposeApache Airflow is a platform for programmatically authoring, scheduling, and monitoring workflows.dagster-slurm lets Dagster assets run locally during development and on a Slurm cluster in production.

Plans

Apache Airflow

  • Apache AirflowFree

Apache Airflow pricing →

dagster-slurm

  • Open-source softwareFree

dagster-slurm pricing →

In their own words

Apache Airflow

Apache Airflow is a platform for authoring, scheduling, and monitoring workflows written in Python. It is designed for batch workflows with a defined beginning and end that run on a schedule. Its web application lets users manage and schedule workflows, trigger DAGs manually, inspect task status and logs, backfill runs, and rerun failed tasks. A modular architecture uses a message queue to coordinate workers and can orchestrate an arbitrary number of them. Built-in operators connect workflows to Google Cloud Platform, Amazon Web Services, Microsoft Azure, and other services. The community maintains more than 80 separately installable provider packages, which can be upgraded or downgraded independently of Airflow core. Airflow can read connections, variables, and configuration from secret backends, but those integrations do not support writes. JWT authentication is used for its public REST API and internal Execution API. From Airflow 3 onward, sensitive credentials are masked in logs, the interface, and API output. Airflow is free to download and use under the Apache License.

Visit airflow.apache.org

dagster-slurm

dagster-slurm has no write-up on Specifiction yet; its figures are above.

Visit dagster-slurm.geoheil.com