Manifest vs vLLM Semantic Router
Manifest
manifest.buildvLLM Semantic Router
vllm-sr.aiSide by side
| Figure | Manifest | vLLM Semantic Router |
|---|---|---|
| Price from | $19/mo | — |
| Free plan | Yes | — |
| Free trial | — | — |
| Open source | Yes | — |
| Web | Yes | — |
| macOS | — | Yes |
| Linux | Yes | Yes |
| API | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 4 | 0 |
| Spec score · LLM gateways | 9.4 (#1) | 7.3 (#26) |
| Spec score · LLM Gateway Software | 9.0 (#4) | 7.2 (#31) |
| Model routing | Sending model auto applies routing rules, fallback behavior and per-harness spending limits. | It can route requests by task, capability, modality, context length, and tool requirements across configured model backends. |
| Product | Manifest is an open-source LLM gateway that routes requests, provides fallbacks, repairs failing requests with Autofix, and tracks spending. | vLLM Semantic Router describes itself as an open, programmable decision layer for models and compute. |
| Support | Free includes community support through Discord, Pro includes basic platform and billing support, and Enterprise includes dedicated Slack and email support. | The site links to GitHub Discussions as a community resource. |
Plans
In their own words
Manifest
Manifest is an open-source LLM gateway for routing model requests, switching providers, repairing certain failures, and tracking inference spending. It provides one endpoint compatible with OpenAI and Anthropic models and subscriptions. When a provider goes down, fallback routing retries through another provider. Autofix repairs malformed requests and resends them when retries alone cannot resolve the error. Observability shows spending by harness, which models handled requests, and what failed. Manifest connects API keys, paid subscriptions, local models, and custom endpoints, including Ollama, llama.cpp, and LM Studio. The self-hosted gateway runs with Docker, works offline, requires no account, and supports amd64 and arm64. Self-hosted routing and request data remain on customer servers except documented telemetry and Autofix flows. The Cloud Free plan allows 10,000 routed requests per calendar month and cannot reach local models on the user's machine. Free includes unlimited self-hosted use; Pro costs $19 a month with unlimited Cloud requests and 365-day dashboard retention.
vLLM Semantic Router
vLLM Semantic Router has no write-up on Specifiction yet; its figures are above.