HAMi vs Moab HPC Suite

HAMi is open-source middleware for sharing and scheduling GPUs and other accelerators among AI workloads on Kubernetes. Workloads can request GPU memory and core limits through Kubernetes resource controls. Scheduling options include binpack, spread and numa-first, with binpack and spread available at node or GPU scope. The supported-device list spans NVIDIA, AMD, AWS Neuron, Huawei Ascend, Cambricon, Enflame, Hygon, Iluvatar, Kunlunxin, MetaX, Moore Threads, Vastai and Biren; isolation and partitioning capabilities vary by device. HAMi works with Kubernetes APIs, DRA and CDI, and documents scheduling integrations including Volcano, Kueue, Koordinator and NVIDIA KAI Scheduler. Its node metrics endpoint exposes device memory and core utilization for Prometheus. Classic HAMi requires Kubernetes v1.23 or later. HAMi-DRA requires Kubernetes v1.34 or later, the DRA Consumable Capacity feature gate, CDI and NVIDIA driver 440 or later. NVIDIA limits use user-space library interception, which does not cover applications that bypass CUDA. Enforcement is described as soft and best-effort; the FAQ recommends MIG when hardware-enforced isolation is required.

Moab HPC Suite is self-hosted software for scheduling workloads and managing resources across high-performance computing infrastructure. It runs on Linux and exposes an API. Scheduling algorithms place jobs and assign resources to improve cluster utilization and reduce waiting. Automatic workload balancing and priority management direct capacity toward critical jobs. Administrators can define scheduling, allocation, and user-access policies, including quota controls. The suite provides cluster-performance and resource-use reporting, GPU utilization metrics, and management of multiple HPC clusters through one interface with unified monitoring and control. Its high-availability architecture includes failover capabilities for continuous operation of critical workloads. Enterprise Edition components include Moab Workload Manager, Moab Web Services, Moab Accounting Manager, and TORQUE Resource Manager. Moab Web Services provides REST access to jobs, nodes, virtual machines, and reservations. Documentation lists TORQUE 5.0.1 and SLURM support, manual and RPM installation, and guides for Red Hat, SUSE, and Ubuntu-based systems. Pricing is available on request.