dstack vs NVIDIA Base Command Manager

dstack is an open-source orchestration layer for AI workloads across GPU clouds, Kubernetes, virtual machines, and bare-metal clusters. YAML configurations define fleets, development environments, tasks, services, presets, and volumes, while dstack handles provisioning and job scheduling, including auto-scaling, port forwarding, and ingress. Supported accelerators include NVIDIA, AMD, TPU, and Tenstorrent. Documented backends include AWS, Azure, GCP, Kubernetes, GPU cloud providers, remote SSH hosts, and experimental Slurm. Tasks can use frameworks such as accelerate, torchrun, Ray, and Spark. Users manage resources through the CLI or HTTP API, and the server can run on a laptop or another environment that can access the clusters in use. Services can publish inference endpoints through gateways with HTTPS, custom domains, auto-scaling, and rate limits. The self-hosted open-source stack is free. Server data and project secrets are stored in plaintext by default unless administrators configure AES-256-GCM encryption. TPU support is limited to single-host instances with up to eight cores. GPU Marketplace usage is prepaid, with prices that vary by GPU and provider and appear in the console before provisioning.

NVIDIA Base Command Manager provides Linux and web tools for deploying and administering compute environments. It supports OS image deployment, PXE bootstrapping, lifecycle management, hardware inventory, API access, and out-of-band management. The Free-to-use Base Command Manager plan costs nothing and allows 8 accelerators per server, node, or system, with no limit on the number of servers, nodes, or systems. A standalone-support option combines the manager license with NVIDIA Enterprise Support. NVIDIA AI Enterprise adds GPU Operator, Network Operator, vGPU, and AI and data-science software. NVIDIA Mission Control includes Run:ai, UFM, NetQ, and additional Mission Control capabilities. The product therefore offers a no-cost base tier alongside options that add support or broader NVIDIA management and software capabilities.