Inference Gateway vs LLM Gateway
Inference Gateway
docs.inference-gateway.comLLM Gateway
llmgateway.ioSide by side
| Figure | Inference Gateway | LLM Gateway |
|---|---|---|
| Price from | — | Free |
| Free plan | — | Yes |
| Free trial | — | Yes |
| Open source | — | Yes |
| Web | Yes | Yes |
| Windows | Yes | — |
| macOS | Yes | — |
| Linux | Yes | Yes |
| API | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 0 | 2 |
| Spec score · Tool Calling | 7.5 (#13) | 8.6 (#5) |
| Spec score · LLM Gateway Software | 7.5 (#24) | 8.7 (#6) |
| Spec score · LLM gateways | 7.0 (#30) | 9.1 (#3) |
| Observability | Built-in observability includes Prometheus metrics, OTLP tracing, structured JSON logs, and reference Grafana dashboards. | Dashboards expose requests, tokens, latency, errors, cache status and spending broken down by model, provider, project and API key. |
| Product | Inference Gateway is an open-source, cloud-native proxy that presents supported hosted and local LLM providers through one OpenAI-compatible API. | LLM Gateway provides one OpenAI-compatible API to route requests across 250+ models from 40+ providers. |
| Provider coverage | The documentation lists providers including OpenAI, Anthropic, Groq, Cohere, Ollama, DeepSeek, Cloudflare, Google, Mistral, MiniMax, Moonshot, Nvidia, and llama.cpp. | The service advertises more than 40 providers and over 250 models, including OpenAI, Anthropic, Google, AWS Bedrock, Azure, Mistral and DeepSeek. |
| Routing | The gateway supports model routing so a stable model alias can point to a pool of upstream deployments. | The gateway can retry up to twice with another provider for the same model when a provider errors, times out, or rate-limits a request. |
Plans
In their own words
Inference Gateway
Inference Gateway has no write-up on Specifiction yet; its figures are above.
LLM Gateway
LLM Gateway provides one OpenAI-compatible API for routing requests among more than 250 models from over 40 providers. If a provider errors, times out, or rate-limits a request, it can retry up to twice with another provider for the same model. Its dashboard tracks request, token, spend, latency, error, and cache metrics, with model and provider breakdowns. Teams can use their own provider API keys without a platform fee and pay providers directly. The open-source core is licensed under AGPLv3 and can be self-hosted for free; enterprise features require a license. The Free plan is free, billed free forever, and has a 5% fee on credit usage. It includes 200+ models across 40+ providers, activity logs and export, and 20 requests per minute on free models; paid models are not rate limited. Enterprise pricing is custom and not listed. It includes custom routing, unlimited data retention, a 99.9% uptime SLA, and 24/7 priority support. Published integration guides cover tools including Claude Code, Cursor, Codex CLI, Cline, n8n, and VS Code.