Skip to content
SPECIFICTION
Get listed

LiteLLM

litellm.ai

Free plan WebAPISelf-hosted
Visit litellm.ai
Spec score 7.8 #15 of 34 in LLM Gateway Software

What it is

LiteLLM is an open-source AI gateway and LLM proxy for platform teams. It provides one OpenAI-compatible API to 140+ providers and 1,800+ models, with load balancing, lowest-cost routing and automatic selection of cheaper models for simple prompts. Teams can track usage and spend across keys, users, teams, organizations, tools, agents and MCP, then apply hard budgets and rate limits. Response and semantic caching can use Redis, S3 or GCS. LiteLLM can be self-hosted, including in air-gapped environments, and offers deployment through an official Helm chart or Terraform module. The maker says self-hosting has no telemetry and keeps data within the user's infrastructure. Listed security features include hardened non-root images, vulnerability scanning, SSO/JWT/RBAC controls and secrets-manager integrations. The free Open Source plan is self-hosted and includes 100+ providers, virtual keys, budgets, rate limits, fallbacks, logging and Prometheus metrics. A 30-day Enterprise trial key is available without a credit card.

Spec sheet

Product
LiteLLM is an open-source AI gateway and LLM proxy for platform teams.Read 2 Oct 2026 · litellm.ai
Intended users
The Enterprise plan is described for teams running LiteLLM in production, including high-volume and regulated deployments.Read 2 Oct 2026 · litellm.ai
Deployment
The gateway can be self-hosted, including in air-gapped environments, and supports deployment with an official Helm chart or Terraform module.Read 2 Oct 2026 · litellm.ai
Trial
The pricing FAQ offers an instant 30-day Enterprise trial key without a credit card.Read 2 Oct 2026 · litellm.ai
Integrations
The integrations documentation lists observability tools including Langfuse, Datadog, Grafana Cloud, OpenTelemetry, LangSmith, Arize/Phoenix, and Helicone.Read 2 Oct 2026 · docs.litellm.ai
Security
The product page describes signed hardened non-root images, vulnerability scanning, SSO/JWT/RBAC controls, and secrets-manager integrations.Read 2 Oct 2026 · litellm.ai
Support
Enterprise includes dedicated support and onboarding, with 24/7 support and SLAs listed on the pricing page.Read 2 Oct 2026 · litellm.ai
Caching
Response and semantic caching can use Redis, S3, or GCS.Read 2 Oct 2026 · litellm.ai
Data handling
LiteLLM says its self-hosted deployment has no telemetry and keeps data within the user's infrastructure.Read 2 Oct 2026 · litellm.ai
Enterprise access
The Enterprise plan includes SSO and SCIM, OIDC/JWT authentication, audit logs, secret managers, key rotation, and organization and team administrators.Read 2 Oct 2026 · litellm.ai
Routing
LiteLLM supports load balancing, lowest-cost routing, and automatic routing of simple prompts to cheaper models.Read 2 Oct 2026 · litellm.ai
Spend controls
It tracks usage and spend by key, user, team, organization, tool, agent, and MCP, and supports hard budgets and rate limits.Read 2 Oct 2026 · litellm.ai
Unified access
The gateway provides one OpenAI-compatible API to 140+ providers and 1,800+ models.Read 2 Oct 2026 · litellm.ai

Plans and prices

Open Source Free Free forever · self-hosted 100+ providers · virtual keys, users and teams · spend tracking · budgets and rate limits · LLM fallbacks · request/response logging · Prometheus metrics Read 2 Oct 2026 · litellm.ai
Enterprise Priced on request Annual · sized to your usage Annual request capacity · priced by deployment architecture and support needs · volume discounts · 24/7 support and SLAs Read 2 Oct 2026 · litellm.ai

Every LiteLLM plan and price →

Strong points and limits

Strong points

  • One API provides access to 140+ providers.
  • Supports budget controls, rate limits and spend tracking.
  • Can be self-hosted, including in air-gapped environments.
  • Free Open Source plan includes virtual keys and fallbacks.
  • Enterprise trial is 30 days with no credit card.

Limits

  • Enterprise is billed annually and sized to usage.
  • The free Open Source plan is self-hosted.

Who it suits

LiteLLM is aimed at platform teams that need a shared gateway, model routing and spend controls. The Enterprise option is described for production teams, including high-volume and regulated deployments.

Verdict

LiteLLM combines provider access with routing, usage controls and self-hosting options. Teams considering Enterprise should request pricing and assess whether its annual, usage-sized plan fits their deployment needs.

Where Specifiction places it

Alternatives to LiteLLMAll alternatives →