LLM Gateway vs Manifest
LLM Gateway
llmgateway.ioManifest
manifest.buildSide by side
| Figure | LLM Gateway | Manifest |
|---|---|---|
| Price from | Free | $19/mo |
| Free plan | Yes | Yes |
| Free trial | Yes | — |
| Open source | Yes | Yes |
| Web | Yes | Yes |
| Linux | Yes | Yes |
| API | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 2 | 4 |
| Spec score · LLM gateways | 9.1 (#3) | 9.4 (#1) |
| Spec score · LLM Gateway Software | 8.7 (#6) | 9.0 (#4) |
| Company size | LinkedIn classifies llm-gateway as a self-employed information-services organization with 2–10 employees. | LinkedIn lists Manifest as a 2–10 employee software-development company. |
| Documentation depth | The documentation includes feature guides, dashboard knowledge-base articles, integration material, self-hosting sections, developer tools and an API reference. | The documentation includes installation, first-request examples, provider setup, environment variables, CLI guidance and deployment paths. |
| Integrations | Published integration guides cover Claude Code, Cursor, Cline, n8n, VS Code, Codex CLI, OpenCode, Continue, Kilo Code, Kimi Code and other coding tools. | Manifest connects API keys, paid subscriptions, local models, and custom endpoints; named local integrations include Ollama, llama.cpp, and LM Studio. |
| Licence | The core gateway, dashboard, API and worker are released under AGPLv3, while code in the ee directory has commercial licensing. | The repository publishes the software under the MIT licence. |
| Observability | Dashboards expose requests, tokens, latency, errors, cache status and spending broken down by model, provider, project and API key. | Usage views show spending, selected models, token consumption and failed requests for each harness. |
| Product | LLM Gateway provides one OpenAI-compatible API to route requests across 250+ models from 40+ providers. | Manifest is an open-source LLM gateway that routes requests, provides fallbacks, repairs failing requests with Autofix, and tracks spending. |
| Provider coverage | The service advertises more than 40 providers and over 250 models, including OpenAI, Anthropic, Google, AWS Bedrock, Azure, Mistral and DeepSeek. | The public repository lists 35 built-in provider connections, 18 subscription flows, 300-plus models and custom OpenAI- or Anthropic-compatible endpoints. |
| SDK compatibility | The product supports existing OpenAI SDKs, cURL, any programming language and a dedicated AI SDK provider package. | Because the API is OpenAI-compatible, existing OpenAI-style SDKs and agents can point at Manifest by changing the base URL. |
| Security | The company states that it is SOC 2 Type II audited and GDPR-aligned, and describes TLS in transit and AES-256 encryption at rest. | Manifest states that data in transit uses TLS, passwords are hashed, and Gateway provider credentials are encrypted with AES-256-GCM. |
| Self-hosting | The gateway can run on customer infrastructure using Docker or Kubernetes with a Helm chart; Enterprise features require a license key. | Docker installation runs the full gateway stack locally without requiring Node.js and starts a dashboard on port 2099. |
| Support | The Free plan lists Discord Community support, while Enterprise includes 24/7 priority support through a dedicated Slack or Discord channel. | Free includes community support through Discord, Pro includes basic platform and billing support, and Enterprise includes dedicated Slack and email support. |
| What it does | LLM Gateway places one OpenAI-compatible API between applications and dozens of model providers, handling routing, credentials, usage and cost tracking. | Manifest is an open-source LLM gateway that routes AI-agent requests across providers, applies fallbacks, repairs failed requests and tracks inference costs. |
Plans
In their own words
LLM Gateway
LLM Gateway provides one OpenAI-compatible API for routing requests among more than 250 models from over 40 providers. If a provider errors, times out, or rate-limits a request, it can retry up to twice with another provider for the same model. Its dashboard tracks request, token, spend, latency, error, and cache metrics, with model and provider breakdowns. Teams can use their own provider API keys without a platform fee and pay providers directly. The open-source core is licensed under AGPLv3 and can be self-hosted for free; enterprise features require a license. The Free plan is free, billed free forever, and has a 5% fee on credit usage. It includes 200+ models across 40+ providers, activity logs and export, and 20 requests per minute on free models; paid models are not rate limited. Enterprise pricing is custom and not listed. It includes custom routing, unlimited data retention, a 99.9% uptime SLA, and 24/7 priority support. Published integration guides cover tools including Claude Code, Cursor, Codex CLI, Cline, n8n, and VS Code.
Manifest
Manifest is an open-source LLM gateway for routing model requests, switching providers, repairing certain failures, and tracking inference spending. It provides one endpoint compatible with OpenAI and Anthropic models and subscriptions. When a provider goes down, fallback routing retries through another provider. Autofix repairs malformed requests and resends them when retries alone cannot resolve the error. Observability shows spending by harness, which models handled requests, and what failed. Manifest connects API keys, paid subscriptions, local models, and custom endpoints, including Ollama, llama.cpp, and LM Studio. The self-hosted gateway runs with Docker, works offline, requires no account, and supports amd64 and arm64. Self-hosted routing and request data remain on customer servers except documented telemetry and Autofix flows. The Cloud Free plan allows 10,000 routed requests per calendar month and cannot reach local models on the user's machine. Free includes unlimited self-hosted use; Pro costs $19 a month with unlimited Cloud requests and 365-day dashboard retention.