dagster-slurm vs Google Cloud Workflows
dagster-slurm
dagster-slurm.geoheil.comGoogle Cloud Workflows
cloud.google.comSide by side
| Figure | dagster-slurm | Google Cloud Workflows |
|---|---|---|
| Price from | Free | $0.01/mo |
| Free plan | Yes | Yes |
| Free trial | — | Yes |
| Open source | — | — |
| Web | — | Yes |
| macOS | Yes | — |
| Linux | Yes | — |
| API | Yes | Yes |
| Self-hosted | Yes | — |
| Plans published | 1 | 6 |
| Spec score · Workflow Orchestration Software | 7.9 (#20) | 8.8 (#7) |
| Observability | Dagster can display Slurm state, logs, CPU efficiency, memory, elapsed time, and node-hours for asset runs. | Workflows automatically integrates with Cloud Logging, Cloud Monitoring, and Cloud Audit Logs for execution and health visibility. |
| Support | The project directs users to GitHub Discussions for questions and how-to requests, GitHub Issues for bugs and feature requests, and Dagster Slack for broader ecosystem questions. | Google Cloud customers, including free trial customers, receive Basic Support with documentation, community forums, billing assistance, and Active Assist. |
Plans
Google Cloud Workflows
- Always FreeFree
- Always Free external stepsFree
- Always Free internal stepsFree
- Internal steps$0.01 a month
- Pay as you go$0.01 a month
- External steps$0.03 a month
In their own words
dagster-slurm
dagster-slurm has no write-up on Specifiction yet; its figures are above.
Google Cloud Workflows
Google Cloud Workflows is a managed orchestration platform for running Google Cloud services, custom services, and HTTP APIs in a chosen sequence. Workflow definitions use YAML or JSON and can combine ordered steps with conditions, loops, parallel work, and reusable subworkflows. Start an execution manually, through client libraries or REST, or on a schedule with Cloud Scheduler. Connectors link workflows to Google Cloud APIs such as Pub/Sub, Firestore, and Secret Manager, while workflow steps can also call custom or private HTTP and HTTPS endpoints. Reliability features include retries, polling, error handling, callbacks, and waits of up to one year. A single execution can run up to 100,000 steps and last no more than one year. IAM controls access; Secret Manager can store and retrieve secrets. Cloud Logging and Cloud Monitoring surface execution logs, volume, errors, and duration. Pricing is based on executed steps, including failed and retried steps, while idle workflows incur no charges. The free plan includes 5,000 internal and 2,000 external steps; paid usage starts at $0.01 per month, with rates that vary by step type and volume.