Apache YuniKorn vs SkyPilot

Apache YuniKorn is a resource scheduler for batch, data, and machine learning workloads on Kubernetes. It is a Kubernetes-compatible alternative to the default scheduler and is described as transparent to existing Kubernetes applications. Hierarchical queues provide fine-grained tenant controls that can reflect an organization’s structure. Scheduling features include gang scheduling, FIFO and Fair job ordering, resource fairness, reservations, and preemption. A web UI centralizes cluster capacity, utilization, and application information. YuniKorn exposes metrics through Prometheus, and project guidance covers monitoring with Prometheus and Grafana. The project recommends deployment to an existing Kubernetes cluster using its Helm chart and Helm 3 or later. The software is free under the Apache License 2.0. Releases include source tarballs, which must be built before use, and prebuilt Docker images. The project advises checking release artifacts for tampering with GPG or SHA-512. Help is available through the YuniKorn Slack #yunikorn-user channel or the user mailing list.

SkyPilot is an AI compute platform that manages Kubernetes, Slurm, virtual machines, on-premises systems and cloud resources through one interface. Listed workloads include development, pre-training, post-training and reinforcement learning, batch inference, sandboxes and inference endpoints. Scheduling provides priority queues, GPU sharing, quotas and intelligent placement across workloads. Fleet health checks can run proactively or reactively, with automatic remediation for GPU and NCCL faults. Integrations include AWS, GCP, Azure, Nebius, CoreWeave, Lambda, RunPod, Kubernetes, Slurm and on-premises infrastructure. SkyPilot can run standalone or connect to a remote API server for multi-user collaboration. Enterprise controls include SSO onboarding, RBAC, workspaces, policy enforcement, a unified dashboard, idle-compute stopping and cost reporting. Deployment options include BYOC, BYOK, private VPC and air-gapped environments. The project began as open source at UC Berkeley's Sky Computing Lab and is offered as open source. Documentation says Slurm support remains under active development and SkyServe on Slurm is not supported.