Apache DolphinScheduler vs Azure Data Factory
Apache DolphinScheduler
dolphinscheduler.apache.org
Azure Data Factory
azure.microsoft.comSide by side
| Figure | Apache DolphinScheduler | Azure Data Factory |
|---|---|---|
| Price from | Free | $0.10/mo |
| Free plan | Yes | — |
| Free trial | — | Yes |
| Open source | Yes | — |
| Web | Yes | Yes |
| Windows | — | Yes |
| Linux | Yes | — |
| API | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 2 | 4 |
| Spec score · Data Orchestration Software | 8.9 (#1) | 8.9 (#2) |
| Documentation depth | Documentation covers installation, architecture, configuration, security, API usage and individual Python task classes with code and YAML examples. | Microsoft Learn provides conceptual guides, tutorials, quickstarts, REST references, SDK examples, CI/CD guidance, limits and security material. |
| Founded | 2017 | 1975 |
| License | The source repositories identify the software as licensed under Apache License 2.0. | Azure Data Factory is proprietary Microsoft Azure software governed by Azure service terms and is not open source. |
| Public API | The API server exposes an Open API documented through a Swagger UI endpoint at /dolphinscheduler/swagger-ui/index.html. | Microsoft publishes a Data Factory REST API covering factory, linked-service, dataset, pipeline, run and monitoring operations. |
| What it does | Apache DolphinScheduler is a distributed workflow-orchestration platform for building and running data-pipeline DAGs through a visual interface. | Azure Data Factory is a fully managed, serverless cloud service for ingesting, transforming, publishing and orchestrating data workflows. |
Plans
Apache DolphinScheduler
- Apache DolphinSchedulerFree
- Open sourceFree
Azure Data Factory
- Data movement (self-hosted IR)$0.10 a month
- Data movement (Azure or managed VNET IR)$0.25 a month
- Pipeline orchestration (Azure integration runtime)$1 a month
- Pipeline orchestration (self-hosted integration runtime)$1.50 a month
In their own words
Apache DolphinScheduler
Apache DolphinScheduler is a free, open-source workflow orchestration platform for designing and running data workflows through visual directed-acyclic-graph interfaces or code. Workflows can be built with drag-and-drop tools or defined in Python, YAML, or the Open API. The project lists more than 30 task types, including Shell, SQL, Spark, Flink, Hive, Kubernetes, and HTTP. Scheduling supports cross-project and cross-workflow dependencies, pause and resume operations, and serial or parallel batch backfills. A decentralized multi-master, multi-worker design is described as increasing scheduling capacity with cluster size. Deployment options are standalone, cluster, and Kubernetes. Standalone is for evaluation, recommended for fewer than 20 workflows, and its in-memory H2 database is cleared when the service stops or restarts. Authentication includes password, LDAP, Casdoor SSO, and OAuth2, with administrator-managed resource controls. The security model assumes a trusted network.
Azure Data Factory
Azure Data Factory has no write-up on Specifiction yet; its figures are above.