Kueue vs NVIDIA Run:ai

Kueue is a free Kubernetes project that manages quotas and job resource consumption, deciding when workloads wait, start, or are preempted. It installs on a standard Kubernetes cluster without replacing existing components. Its scheduling tools include priority-based queues, fair sharing, quota borrowing between teams, resource flavor fungibility, preemption policies, and all-or-nothing scheduling. Built-in integrations cover Kubernetes Jobs and Pods, Kubeflow training jobs, Ray jobs and clusters, JobSet, AppWrapper, Deployments, StatefulSets, and LeaderWorkerSet. MultiKueue can find capacity and dispatch workloads across clusters, while topology-aware scheduling accounts for data center layout to improve communication throughput between pods. Kueue provides Prometheus metrics and an endpoint for viewing pending workloads. Installation instructions cover kubectl, Helm, and source builds. The guide recommends Kubernetes 1.34 or newer and officially supports and tests only those versions. Kueue also provides administrator and user ClusterRoles, with resource-specific roles that can be composed into custom roles. Its webhook server includes internal certificate management, and the installation guide links to cert-manager instructions.

NVIDIA Run:ai has no write-up on Specifiction yet; its figures are above.