Argo Workflows vs dagster-slurm
Argo Workflows
argoproj.github.iodagster-slurm
dagster-slurm.geoheil.comSide by side
| Figure | Argo Workflows | dagster-slurm |
|---|---|---|
| Price from | Free | Free |
| Free plan | Yes | Yes |
| Free trial | — | — |
| Open source | — | — |
| Web | Yes | — |
| Windows | Yes | — |
| macOS | Yes | Yes |
| Linux | Yes | Yes |
| API | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 1 | 1 |
| Spec score · Workflow Orchestration Software | 8.6 (#9) | 7.9 (#20) |
| Observability | The feature list includes Prometheus metrics and a UI for visualizing and managing workflows. | Dagster can display Slurm state, logs, CPU efficiency, memory, elapsed time, and node-hours for asset runs. |
| Purpose | Argo Workflows is an open-source, container-native engine for orchestrating parallel jobs on Kubernetes. | dagster-slurm lets Dagster assets run locally during development and on a Slurm cluster in production. |
| Support | The project directs users with questions to GitHub Discussions and Slack and describes monthly community meetings. | The project directs users to GitHub Discussions for questions and how-to requests, GitHub Issues for bugs and feature requests, and Dagster Slack for broader ecosystem questions. |
Plans
In their own words
Argo Workflows
Argo Workflows is a free, open-source engine for orchestrating container-based jobs on Kubernetes. Workflows can be arranged as sequential steps or as tasks linked in a directed acyclic graph, with each step running in a container. The project lists machine learning pipelines, data and batch processing, infrastructure automation, and CI/CD as use cases. Controls include loops, conditionals, retries, timeouts, suspension and resumption, cancellation, and limits on parallel work. Cron scheduling, workflow archiving, a UI for viewing and managing runs, and Prometheus metrics are included. Artifact support covers S3, Artifactory, Alibaba Cloud OSS, Azure Blob Storage, HTTP, Git, GCS, raw artifacts, and plugins. The server provides REST API support over HTTP and gRPC, with client libraries for Java, Go, Python, and TypeScript. Argo Workflows is self-hosted and can run on any Kubernetes cluster. Its listed plan costs nothing, and the official pages list no paid plans or usage limits. Administrators should configure transport security, authentication, roles, and permissions; workflow pods run as root by default unless their security context is set.
dagster-slurm
dagster-slurm has no write-up on Specifiction yet; its figures are above.