SkyPilot vs Slurm Workload Manager

SkyPilot is an AI compute platform that manages Kubernetes, Slurm, virtual machines, on-premises systems and cloud resources through one interface. Listed workloads include development, pre-training, post-training and reinforcement learning, batch inference, sandboxes and inference endpoints. Scheduling provides priority queues, GPU sharing, quotas and intelligent placement across workloads. Fleet health checks can run proactively or reactively, with automatic remediation for GPU and NCCL faults. Integrations include AWS, GCP, Azure, Nebius, CoreWeave, Lambda, RunPod, Kubernetes, Slurm and on-premises infrastructure. SkyPilot can run standalone or connect to a remote API server for multi-user collaboration. Enterprise controls include SSO onboarding, RBAC, workspaces, policy enforcement, a unified dashboard, idle-compute stopping and cost reporting. Deployment options include BYOC, BYOK, private VPC and air-gapped environments. The project began as open source at UC Berkeley's Sky Computing Lab and is offered as open source. Documentation says Slurm support remains under active development and SkyServe on Slurm is not supported.

Slurm Workload Manager is free, open-source software for allocating compute resources and scheduling work across Linux clusters. It starts and monitors jobs on allocated nodes and manages queues of pending work. Optional plugins add accounting, advanced reservations, gang and backfill scheduling, topology-aware resource selection, resource limits, and multifactor job prioritization. The system uses a central slurmctld manager and slurmd daemons on compute nodes; accounting and REST components are optional. GPU plugins support NVIDIA, AMD, Intel, AWS Trainium, and AWS Inferentia accelerators, along with NVIDIA MPS and GPU sharing. Accounting can use MySQL or MariaDB and can record data in a text file, directly in a database, or through slurmdbd for multiple clusters. Slurmrestd provides REST access, but the API is not designed for direct internet exposure and supports only unencrypted HTTP. Linux is thoroughly tested on arm64, ppc64, and x86_64; FreeBSD and NetBSD support is limited, and macOS is unsupported. Deployment is self-hosted.