HAMi vs SkyPilot
HAMi
project-hami.io
SkyPilot
skypilot.aiSide by side
| Figure | HAMi | SkyPilot |
|---|---|---|
| Price from | Free | — |
| Free plan | Yes | — |
| Free trial | — | — |
| Open source | — | — |
| Web | — | Yes |
| Linux | Yes | Yes |
| API | — | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 1 | 0 |
| Spec score · GPU Cluster Management Software | 8.3 (#5) | 6.9 (#16) |
| Integrations | The site lists Kubernetes, Volcano, Kueue, Koordinator and KAI Scheduler in its Kubernetes scheduling ecosystem. | The site lists Kubernetes, Slurm, AWS, GCP, Azure, Nebius, CoreWeave, Lambda, RunPod, and other cloud and compute providers. |
| Product | HAMi is open-source GPU virtualization middleware that enables sharing, isolation and scheduling of heterogeneous accelerators for AI workloads on Kubernetes. | SkyPilot unifies Kubernetes, Slurm, VMs, and on-premises compute to run AI workloads across the AI lifecycle. |
| Purpose | HAMi is open-source, cloud-native GPU virtualization middleware for sharing, isolating, and scheduling heterogeneous accelerators on Kubernetes. | SkyPilot is an AI compute platform for managing Kubernetes, Slurm, VMs, on-premises systems, and cloud resources through one interface. |
| Scheduling | HAMi offers binpack, spread, and topology-aware scheduling policies. | SkyPilot offers workload scheduling, GPU monitoring, quotas, priority queueing, GPU sharing, and GPU health checks with auto-remediation. |
| Support | The site links to documentation, tutorials, Discord and the `#hami-dev` Slack channel for community resources. | The maker invites users to connect with the SkyPilot team and community through Slack. |
| Workloads | The site identifies LLM, machine-learning, and HPC workloads as use cases. | The platform supports AI development, pre-training, post-training and reinforcement learning, batch inference, sandboxes, and inference endpoints. |
Plans
In their own words
HAMi
HAMi is open-source middleware for sharing and scheduling GPUs and other accelerators among AI workloads on Kubernetes. Workloads can request GPU memory and core limits through Kubernetes resource controls. Scheduling options include binpack, spread and numa-first, with binpack and spread available at node or GPU scope. The supported-device list spans NVIDIA, AMD, AWS Neuron, Huawei Ascend, Cambricon, Enflame, Hygon, Iluvatar, Kunlunxin, MetaX, Moore Threads, Vastai and Biren; isolation and partitioning capabilities vary by device. HAMi works with Kubernetes APIs, DRA and CDI, and documents scheduling integrations including Volcano, Kueue, Koordinator and NVIDIA KAI Scheduler. Its node metrics endpoint exposes device memory and core utilization for Prometheus. Classic HAMi requires Kubernetes v1.23 or later. HAMi-DRA requires Kubernetes v1.34 or later, the DRA Consumable Capacity feature gate, CDI and NVIDIA driver 440 or later. NVIDIA limits use user-space library interception, which does not cover applications that bypass CUDA. Enforcement is described as soft and best-effort; the FAQ recommends MIG when hardware-enforced isolation is required.
SkyPilot
SkyPilot is an AI compute platform that manages Kubernetes, Slurm, virtual machines, on-premises systems and cloud resources through one interface. Listed workloads include development, pre-training, post-training and reinforcement learning, batch inference, sandboxes and inference endpoints. Scheduling provides priority queues, GPU sharing, quotas and intelligent placement across workloads. Fleet health checks can run proactively or reactively, with automatic remediation for GPU and NCCL faults. Integrations include AWS, GCP, Azure, Nebius, CoreWeave, Lambda, RunPod, Kubernetes, Slurm and on-premises infrastructure. SkyPilot can run standalone or connect to a remote API server for multi-user collaboration. Enterprise controls include SSO onboarding, RBAC, workspaces, policy enforcement, a unified dashboard, idle-compute stopping and cost reporting. Deployment options include BYOC, BYOK, private VPC and air-gapped environments. The project began as open source at UC Berkeley's Sky Computing Lab and is offered as open source. Documentation says Slurm support remains under active development and SkyServe on Slurm is not supported.