OpenZiti LLM Gateway vs Requesty
OpenZiti LLM Gateway
github.comRequesty
requesty.aiSide by side
| Figure | OpenZiti LLM Gateway | Requesty |
|---|---|---|
| Price from | — | Free |
| Free plan | — | Yes |
| Free trial | — | Yes |
| Open source | — | — |
| Web | — | Yes |
| Windows | Yes | — |
| macOS | Yes | — |
| Linux | Yes | — |
| API | Yes | Yes |
| Self-hosted | Yes | — |
| Plans published | 0 | 3 |
| Spec score · LLM gateways | 7.1 (#27) | 8.5 (#8) |
| Spec score · LLM Gateway Software | 7.4 (#28) | 8.3 (#10) |
| Headquarters | Charlotte, North Carolina, United States | London, United Kingdom |
| Integrations | Documented backends include OpenAI, Anthropic, Ollama, vLLM, llama-server, and SGLang; clients use an OpenAI-compatible API. | Official integration guidance covers OpenAI SDK, LangChain, PydanticAI, Vercel AI SDK, Haystack, LlamaIndex, Axios and plain HTTP. |
| Load balancing | It supports weighted round-robin across inference endpoints, health checks, and failover. | Routing policies support weighted load balancing and latency-based selection, and policies can be nested. |
| Observability | When enabled, Prometheus-exported metrics include request counts, latency, token counts, routing decisions, provider errors, and endpoint health. | Requesty offers real-time cost tracking and analytics by model, user and team, plus latency and usage monitoring. |
| Routing | Optional semantic routing uses keyword heuristics, embedding similarity, and an LLM classifier to choose a model when the request omits one. | The gateway supports policy-based routing, regional routing, automatic failover and load balancing. |
Plans
In their own words
OpenZiti LLM Gateway
OpenZiti LLM Gateway has no write-up on Specifiction yet; its figures are above.
Requesty
Requesty is a managed AI gateway that gives applications access to more than 600 models through one API. Its OpenAI-compatible API can work with existing SDK code after changing the base URL and API key. Routing features include policy and regional rules, automatic failover and load balancing. Requesty tracks cost, latency and usage, with analytics by model, user and team. Governance options include PII detection and scrubbing, content guardrails, team roles, model allowlists and audit logs. Named integrations include OpenAI, LangChain, PydanticAI, Vercel AI SDK, Haystack and LlamaIndex TS; the integrations page also lists tools such as Claude Code, Cline, VS Code, GitHub Copilot, Codex, n8n, LibreChat and OpenWebUI. The Free plan costs nothing and allows 200 requests per day. Pay as you go costs $5 a month, with a 5% markup on model cost. Enterprise pricing is custom. Requesty is available via API and web; self-hosting is not offered.