Skip to content
SPECIFICTION
Get listed

GPUStack

gpustack.ai

Free plan WebWindowsmacOSLinuxAPISelf-hosted
Visit gpustack.ai
Spec score 8.3 #4 of 21 in GPU Cluster Management Software

What it is

GPUStack is an open-source GPU cluster manager for deploying, governing, and scaling AI models across on-premise, cloud, or hybrid infrastructure. It provides OpenAI-compatible and Anthropic-compatible inference endpoints, with support for engines such as vLLM, SGLang, llama.cpp, TensorRT-LLM, and MindIE. Users can browse models from Hugging Face and ModelScope or supply local files, with automated compatibility checks. GPUStack can provision GPU instances with lifecycle controls, partitioning, SSH key injection, Jupyter access, and persistent S3 or NFS storage. Deployment options include on-premise, Kubernetes, and multi-cloud, including air-gapped deployments. The maker lists support for accelerators from NVIDIA, AMD, Ascend, T-head, Hygon, MetaX, Moore Threads, Cambricon, and Iluvatar. Security controls include RBAC, multi-tenancy, SSO, scoped API keys, IP allowlisting, token quotas, and usage analytics. GPUStack Community Edition is free. Worker nodes support Linux only; Windows users are directed to consider WSL2, and macOS worker nodes are not supported.

Spec sheet

What it does
GPUStack is an open-source GPU cluster manager for deploying, governing, and scaling AI models across on-premise, cloud, or hybrid infrastructure.Read 29 Sep 2026 · gpustack.ai
Deployment
It supports on-premise, Kubernetes, and multi-cloud GPU deployments, and the maker states that air-gapped deployments are supported.Read 29 Sep 2026 · gpustack.ai
Integrations
Listed integrations include OpenWebUI, LangChain, n8n, Dify, RAGFlow, Claude Code, OpenClaw, Docker, Podman, Kubernetes, Helm, Prometheus, and Grafana.Read 29 Sep 2026 · gpustack.ai
Security
The site lists RBAC, multi-tenancy, OIDC/SAML/AD-LDAP SSO, scoped API keys, IP allowlisting, token quotas, and usage analytics.Read 29 Sep 2026 · gpustack.ai
Support
The contact page offers personalized demos and architecture, deployment, and scaling guidance, and says replies typically arrive within one business day.Read 29 Sep 2026 · gpustack.ai
Headquarters
Shenzhen, Guangdong, ChinaRead 28 Sep 2026 · gpustack.ai
Enterprise availability
GPUStack Enterprise describes control-plane and model-service high availability with automatic failover and traffic rerouting.Read 29 Sep 2026 · gpustack.ai
Enterprise licensing
The contact page directs users to contact the company for pricing and Enterprise Edition licensing.Read 29 Sep 2026 · gpustack.ai
Enterprise security
GPUStack Enterprise describes immutable audit logs, CIDR-based IP allowlists and blocklists, and per-model and per-API-key access rules.Read 29 Sep 2026 · gpustack.ai
GPU service
GPUStack can provision GPU instances with lifecycle controls, GPU partitioning, SSH key injection, Jupyter access, and persistent S3 or NFS storage.Read 29 Sep 2026 · gpustack.ai
Inference APIs
It exposes models through OpenAI-compatible and Anthropic-compatible endpoints.Read 29 Sep 2026 · gpustack.ai
Inference engines
The platform supports inference engines including vLLM, SGLang, llama.cpp, TensorRT-LLM, and MindIE.Read 29 Sep 2026 · gpustack.ai
Linux worker requirement
The Docker installation page says GPUStack worker nodes support Linux only; Windows users are directed to consider WSL2, and macOS is not supported for worker nodes.Read 29 Sep 2026 · docs.gpustack.ai
Model sources
Users can browse and download models from Hugging Face and ModelScope or provide local model files, with automated compatibility checks.Read 29 Sep 2026 · gpustack.ai
Supported hardware
The maker lists NVIDIA, AMD, Ascend, T-head, Hygon, MetaX, Moore Threads, Cambricon, and Iluvatar accelerators.Read 29 Sep 2026 · gpustack.ai

Plans and prices

GPUStack Community Edition Free Open-source GPU cluster manager Read 29 Sep 2026 · gpustack.ai

Every GPUStack plan and price →

Strong points and limits

Strong points

  • Free open-source Community Edition
  • OpenAI- and Anthropic-compatible inference endpoints
  • Supports several deployment models, including air-gapped
  • GPU provisioning includes persistent storage options

Limits

  • Worker nodes support Linux only
  • macOS worker nodes are unsupported

Who it suits

GPUStack suits teams deploying AI models across on-premise, cloud, or hybrid infrastructure, including Kubernetes and air-gapped environments. It is also relevant to teams needing GPU provisioning and model access controls.

Verdict

GPUStack combines model serving, GPU instance management, and access controls across multiple deployment environments. Worker-node operating system support is limited to Linux, with WSL2 suggested for Windows users.

Where Specifiction places it

Alternatives to GPUStackAll alternatives →