Apache DolphinScheduler vs Databricks Workflows

Apache DolphinScheduler is a free, open-source workflow orchestration platform for designing and running data workflows through visual directed-acyclic-graph interfaces or code. Workflows can be built with drag-and-drop tools or defined in Python, YAML, or the Open API. The project lists more than 30 task types, including Shell, SQL, Spark, Flink, Hive, Kubernetes, and HTTP. Scheduling supports cross-project and cross-workflow dependencies, pause and resume operations, and serial or parallel batch backfills. A decentralized multi-master, multi-worker design is described as increasing scheduling capacity with cluster size. Deployment options are standalone, cluster, and Kubernetes. Standalone is for evaluation, recommended for fewer than 20 workflows, and its in-memory H2 database is cleared when the service stops or restarts. Authentication includes password, LDAP, Casdoor SSO, and OAuth2, with administrator-managed resource controls. The security model assumes a trusted network.

Databricks Workflows has no write-up on Specifiction yet; its figures are above.