Skip to content
SPECIFICTION
Get listed

LLM Gateway

llmgateway.io

Free plan Open source WebLinuxAPISelf-hostedBrowser extension
Visit llmgateway.io
Spec score 9.1 #3 of 33 in LLM gateways

What it is

LLM Gateway provides one OpenAI-compatible API for routing requests among more than 250 models from over 40 providers. If a provider errors, times out, or rate-limits a request, it can retry up to twice with another provider for the same model. Its dashboard tracks request, token, spend, latency, error, and cache metrics, with model and provider breakdowns. Teams can use their own provider API keys without a platform fee and pay providers directly. The open-source core is licensed under AGPLv3 and can be self-hosted for free; enterprise features require a license. The Free plan is free, billed free forever, and has a 5% fee on credit usage. It includes 200+ models across 40+ providers, activity logs and export, and 20 requests per minute on free models; paid models are not rate limited. Enterprise pricing is custom and not listed. It includes custom routing, unlimited data retention, a 99.9% uptime SLA, and 24/7 priority support. Published integration guides cover tools including Claude Code, Cursor, Codex CLI, Cline, n8n, and VS Code.

Spec sheet

What it does
LLM Gateway places one OpenAI-compatible API between applications and dozens of model providers, handling routing, credentials, usage and cost tracking.Read 15 Oct 2026 · docs.llmgateway.io
Product
LLM Gateway provides one OpenAI-compatible API to route requests across 250+ models from 40+ providers.Read 7 Oct 2026 · llmgateway.io
Integrations
Published integration guides cover Claude Code, Cursor, Cline, n8n, VS Code, Codex CLI, OpenCode, Continue, Kilo Code, Kimi Code and other coding tools.Read 15 Oct 2026 · llmgateway.io
Security
The company states that it is SOC 2 Type II audited and GDPR-aligned, and describes TLS in transit and AES-256 encryption at rest.Read 7 Oct 2026 · llmgateway.io
Support
The Free plan lists Discord Community support, while Enterprise includes 24/7 priority support through a dedicated Slack or Discord channel.Read 7 Oct 2026 · llmgateway.io
Analytics
The dashboard tracks request, token, spend, latency, error, and cache metrics, with breakdowns by model and provider.Read 7 Oct 2026 · llmgateway.io
API surface
Documented endpoints include chat completions, responses, Anthropic messages, embeddings, images, speech, transcription, moderation, search, video and realtime operations.Read 15 Oct 2026 · docs.llmgateway.io
Automatic routing
The gateway selects providers using availability, latency, throughput, price and cache-related signals, with configurable routing behavior.Read 15 Oct 2026 · docs.llmgateway.io
BYOK
Customers may store their own provider keys and use routing and analytics without a platform fee.Read 15 Oct 2026 · llmgateway.io
Caching
Projects can enable response caching to reduce repeated-request latency and token expense.Read 15 Oct 2026 · docs.llmgateway.io
Company size
LinkedIn classifies llm-gateway as a self-employed information-services organization with 2–10 employees.Read 15 Oct 2026 · linkedin.com
Credit pricing
Pay-as-you-go credits use provider list token rates plus a flat 5% fee when credits are purchased; international cards add 1.5%.Read 15 Oct 2026 · llmgateway.io
Data retention
Pricing lists metadata retention as free and full payload retention at $0.01 per 1 million tokens; the Free plan includes activity logs and export.Read 7 Oct 2026 · llmgateway.io
Documentation depth
The documentation includes feature guides, dashboard knowledge-base articles, integration material, self-hosting sections, developer tools and an API reference.Read 15 Oct 2026 · docs.llmgateway.io
Enterprise identity
Enterprise SSO supports SAML 2.0 and OIDC with SCIM provisioning and group-based role mapping.Read 7 Oct 2026 · llmgateway.io
Enterprise limits
Enterprise plans include unlimited seats and unlimited data retention, according to the enterprise page.Read 7 Oct 2026 · llmgateway.io
Enterprise pricing
Enterprise pricing is contact-based and offers volume discounts, custom limits and contractual service levels.Read 15 Oct 2026 · llmgateway.io
Failover
When a provider errors, times out or rate-limits, the gateway can retry on another provider for the same model, up to two times.Read 15 Oct 2026 · llmgateway.io
Guardrails
Enterprise guardrails can detect prompt injection, jailbreak attempts, personally identifying information, payment-card data and secrets, with block, redact or warn actions.Read 15 Oct 2026 · llmgateway.io
Identity controls
Enterprise supports SAML 2.0 or OIDC single sign-on, SCIM provisioning and organization/project roles.Read 15 Oct 2026 · llmgateway.io
Independent assessment: API caveat
GatewayScore reports that latency-based routing applies only to streaming requests and that non-auto tool choices may be downgraded when no mapping supports them.Read 15 Oct 2026 · gatewayscore.com
Independent assessment: compliance gap
GatewayScore says SOC 2 is published but found no unconditional zero-retention guarantee or HIPAA business-associate agreement.Read 15 Oct 2026 · gatewayscore.com
Independent assessment: deployment documentation
GatewayScore found hosted and self-host deployment documented, while VPC, on-premises and air-gapped deployment were not documented on the reviewed pages.Read 15 Oct 2026 · gatewayscore.com
Independent assessment: pricing
Vantaige characterizes the gateway as freemium, with free BYOK and self-hosting and a 5% managed-credit fee.Read 15 Oct 2026 · vantaige.io
Independent praise: unified access
The same Reddit announcement highlights one API, provider fallback and usage/cost tracking as the core benefit for application developers.Read 15 Oct 2026 · reddit.com
Independent product description
A Reddit post by a project builder describes hosted pay-as-you-go access, provider-key mode and AGPLv3 self-hosting, with separate commercial licensing for enterprise code.Read 15 Oct 2026 · reddit.com
Independent technical footprint
Gridinsoft detected React, Next.js, Sonner notifications, Google Cloud hosting and a linked GitHub profile for the site.Read 15 Oct 2026 · gridinsoft.com
Independent trust check
Gridinsoft gave llmgateway.io a 76/100 automated trust score, reporting no major malware or phishing detections and a domain registration date of May 20, 2025.Read 15 Oct 2026 · gridinsoft.com
Licence
The core gateway, dashboard, API and worker are released under AGPLv3, while code in the ee directory has commercial licensing.Read 15 Oct 2026 · llmgateway.io
Limit: credit fees
Vantaige reports a $10 minimum and $5,000 maximum per credit top-up, plus the international-card surcharge.Read 15 Oct 2026 · vantaige.io
Limit: self-hosting burden
Vantaige identifies infrastructure and on-call work as the practical cost of leaving the managed cloud for self-hosting.Read 15 Oct 2026 · vantaige.io
Maker legal entity
The service is operated by Polar Lights LLC at 16192 Coastal Highway, Lewes, Delaware, United States.Read 15 Oct 2026 · llmgateway.io
Observability
Dashboards expose requests, tokens, latency, errors, cache status and spending broken down by model, provider, project and API key.Read 15 Oct 2026 · llmgateway.io
Provider coverage
The service advertises more than 40 providers and over 250 models, including OpenAI, Anthropic, Google, AWS Bedrock, Azure, Mistral and DeepSeek.Read 15 Oct 2026 · llmgateway.io
Recent news
On October 9, 2026 the company moved full request-and-response retention to Enterprise, leaving new organizations on metadata-only logs.Read 15 Oct 2026 · llmgateway.io
Routing
The gateway can retry up to twice with another provider for the same model when a provider errors, times out, or rate-limits a request.Read 7 Oct 2026 · llmgateway.io
SDK compatibility
The product supports existing OpenAI SDKs, cURL, any programming language and a dedicated AI SDK provider package.Read 15 Oct 2026 · llmgateway.io
Security compliance
The trust center lists SOC 2 Type 2 as compliant and GDPR as in progress, with security policies, controls and a penetration-test document available.Read 15 Oct 2026 · security.llmgateway.io
Self-hosting
The gateway can run on customer infrastructure using Docker or Kubernetes with a Helm chart; Enterprise features require a license key.Read 15 Oct 2026 · llmgateway.io
Service status
On October 15, 2026 the status page reported all services online, with 99.995% gateway uptime and 99.990% website uptime over the displayed period.Read 15 Oct 2026 · status.llmgateway.io
Spend controls
API keys and members can receive spending caps and optional alerts, while Enterprise adds team budgets.Read 15 Oct 2026 · llmgateway.io
Unified API
Applications can target https://api.llmgateway.io/v1 and change model identifiers instead of rewriting provider integrations.Read 15 Oct 2026 · docs.llmgateway.io
Who it serves
The product describes itself as serving product and platform teams, while enterprise features target organizations deploying LLM infrastructure across teams.Read 7 Oct 2026 · llmgateway.io

Plans and prices

Free Free forever 200+ models · 40+ providers · free models rate-limited to 20 requests/minute · metadata-only logs · Discord support Read 15 Oct 2026 · llmgateway.io
Enterprise Priced on request custom 30-day trial · all models · custom routing · full payload retention for 30 days · SSO/SAML/OIDC with SCIM · audit logs · guardrails · contractual SLA · 24/7 support Read 15 Oct 2026 · llmgateway.io

Every LLM Gateway plan and price →

Strong points and limits

Strong points

  • Retries failed requests up to twice through another provider
  • Tracks spend, latency, errors, and cache metrics
  • Core can be self-hosted for free
  • BYOK has no platform fee

Limits

  • Free plan charges 5% on credit usage
  • Free models are limited to 20 requests per minute
  • Enterprise price is custom and not listed

Who it suits

LLM Gateway suits product and platform teams routing requests across model providers, including teams that want to self-host the open-source core. Enterprise features target organizations deploying LLM infrastructure across teams.

LLM Gateway in depth

Read the full write-up

LLM Gateway is a common API layer for routing applications across a large selection of language models and providers. It suits product and platform teams that need failover, centralized credentials, and usage accounting, particularly when they bring their own provider keys. Its open-source core and permanent free option make adoption straightforward, while enterprise identity and guardrails are reserved for a custom contract.

Overview

The gateway exposes one OpenAI-compatible API for more than 250 models from over 40 providers. That single integration point reduces the need to rework applications when changing providers or models. If a provider errors, times out, or rate-limits a request, the gateway can retry up to twice with another provider serving the same model. This is a practical availability safeguard, although teams still choose providers and remain responsible for their provider accounts.

Requests can be organized through virtual API keys, budget controls, and fallback routing. The dashboard reports request, token, spend, latency, error, and cache metrics, with views by model and provider. Those dimensions are useful for finding expensive or unreliable routes rather than treating all traffic as one undifferentiated total.

Bring-your-own-key operation has no platform fee: the provider bills the user directly. Credit-based use is different, with the Free plan charging 5% on credit usage. Metadata retention is free, while full payload retention costs $0.01 per 1 million tokens; Free includes activity logs and export.

Key features

Routing and operations

Two retry attempts with another provider give latency- or outage-sensitive applications a defined fallback behavior. The gateway's coverage of 250+ models and 40+ providers is broad enough for teams standardizing several integrations behind one endpoint. Custom routing is an Enterprise feature, so the Free plan is better for straightforward provider failover than for elaborate traffic policies.

Analytics and access

Breakdowns for spend, tokens, latency, errors, requests, and cache activity help teams allocate costs and investigate service quality. Virtual API keys and budget controls support a shared gateway for multiple applications or teams. They provide governance primitives, but the published plans do not promise automatic optimization of provider prices or model choice.

Deployment and security

The core gateway is open source under AGPLv3 and can be self-hosted at no cost. Enterprise features require a license. The company describes SOC 2 Type II auditing, GDPR alignment, TLS in transit, and AES-256 encryption at rest. Enterprise guardrails can detect prompt injection, personally identifiable information, and secrets, with central configuration. Enterprise SSO supports SAML 2.0 and OIDC, plus SCIM provisioning and group-based role mapping. Those controls are relevant to organizations deploying LLM infrastructure across departments, but they are not part of the free offering.

Published integration guides cover Claude Code, Cursor, Codex CLI, Cline, Continue CLI, GitHub Copilot, n8n, OpenCode, and VS Code, giving teams using those tools a documented route into the gateway.

Pricing

Free

The Free plan costs free, billed Free forever. It covers 200+ models across 40+ providers, allows 20 requests per minute on free models, and does not rate-limit paid models. Credit usage carries a 5% fee; BYOK avoids a platform fee but leaves provider charges with the user. Discord Community support, activity logs, and export are included. This is a sensible starting point for prototypes and smaller deployments that can stay within the free-model request quota.

Enterprise

Enterprise uses custom pricing and requires contacting the company. It adds volume discounts, custom routing, unlimited data retention, a 99.9% uptime SLA, and 24/7 priority support through a dedicated Slack or Discord channel. Enterprise plans include unlimited seats. Organizations needing SSO, SCIM, centrally managed guardrails, or contractual availability should budget for this tier; it is not a small step-up from Free but a separately negotiated deployment.

Platforms

LLM Gateway is offered as an API and web service, runs on Linux, and supports self-hosted deployment. The self-hosted route is particularly relevant to teams that need control over where the AGPLv3 core runs, while web access suits teams that prefer the hosted dashboard.

Who it's for

Product and platform teams are the primary fit: one API, provider fallback, virtual keys, budgets, and analytics address the operational friction of running several model integrations. Self-hosting makes it attractive to teams able to operate open-source infrastructure and wanting to avoid a platform fee when using their own keys. Enterprise buyers should consider it when multiple teams need centralized identity, retention, guardrails, support, and an uptime commitment. It is less compelling for a small project that only needs one provider and has no need for routing or shared usage controls.

Pros and cons

Pros

Broad provider coverage: one OpenAI-compatible endpoint spans 250+ models and 40+ providers.

Defined failover: up to two retries with another provider can reduce disruption from errors, timeouts, and rate limits.

Useful cost visibility: model- and provider-level spend, token, latency, error, and cache metrics support practical oversight.

Flexible economics: BYOK has no platform fee, and the AGPLv3 core can be self-hosted for free.

Serious enterprise controls: SSO, SCIM, guardrails, unlimited seats and retention, SLA, and priority support are available together.

Cons

Free request ceiling: free models are limited to 20 requests per minute, which can constrain busy prototypes.

Credit surcharge: the Free plan's 5% charge makes BYOK more attractive for cost-sensitive users.

Enterprise dependency: custom routing, identity controls, guardrails, and contractual support require custom pricing.

Self-hosting responsibility: running the open-source core shifts deployment and operations work to the customer.

Alternatives

Choose Bifrost instead if an Apache 2.0 self-hosted gateway and deployment through npx, Docker, Kubernetes, or a Go binary are the priority.

Kong Gateway is the better fit when a 30-day, no-credit-card trial and a broader API-gateway product are more important than LLM Gateway's focused routing model.

Pick YoloRouter for a self-hosted single binary with SQLite out of the box and optional PostgreSQL.

Requesty suits teams wanting a free allowance of 200 requests per day, routing, caching, fallbacks, spend analytics, and EU data residency.

Choose TrueFoundry AI Gateway when a per-user developer plan and explicit user, request, model-account, and MCP-server quotas match your rollout.

WSO2 AI Gateway is an alternative for organizations evaluating a managed 30-day trial with stated API, MCP, event, and hybrid-gateway allowances.

Envoy AI Gateway is a free open-source project for self-managed Linux or macOS deployments.

Consider Helicone when an open-source observability-focused gateway with a free Hobby allowance is the preferred starting point.

Verdict

LLM Gateway is a strong choice for product and platform teams that want one API, provider failover, and actionable usage accounting, with the option to bring their own keys or self-host the AGPLv3 core. Choose it especially when several applications share model infrastructure. Look elsewhere if you need enterprise controls without a custom contract, cannot operate a self-hosted service, or your workload is small enough that a single provider needs no gateway.

Verdict

LLM Gateway combines provider routing, retry behavior, and usage analytics behind one API. The free plan has specific rate and credit-fee terms; enterprise pricing requires a custom quote.

Where Specifiction places it

Alternatives to LLM GatewayAll alternatives →