Requesty vs TensorZero
Requesty
requesty.ai
TensorZero
tensorzero.comSide by side
| Figure | Requesty | TensorZero |
|---|---|---|
| Price from | Free | Free |
| Free plan | Yes | Yes |
| Free trial | Yes | — |
| Open source | — | — |
| Web | Yes | Yes |
| Linux | — | Yes |
| API | Yes | Yes |
| Self-hosted | — | Yes |
| Plans published | 3 | 1 |
| Spec score · LLM gateways | 8.5 (#8) | 8.6 (#7) |
| Spec score · LLM Gateway Software | 8.3 (#10) | 8.0 (#13) |
| Spec score · Byok System | 8.2 (#13) | 7.9 (#15) |
| Integrations | Official integration guidance covers OpenAI SDK, LangChain, PydanticAI, Vercel AI SDK, Haystack, LlamaIndex, Axios and plain HTTP. | Documented providers include Anthropic, AWS Bedrock, Azure, Google, OpenAI, OpenRouter, Together AI, vLLM, and OpenAI-compatible endpoints. |
| Observability | Requesty offers real-time cost tracking and analytics by model, user and team, plus latency and usage monitoring. | TensorZero can store inference and feedback data for observability, optimization, evaluations, and experimentation in Postgres or ClickHouse. |
| Product | Requesty describes itself as an AI gateway that provides access to 600+ models through one API with routing, analytics and centralized governance. | TensorZero is an open-source platform that combines an LLM gateway, observability, evaluation, optimization, and experimentation. |
| Security | The security page states that traffic is encrypted with TLS 1.2 or higher and data at rest with AES-256. | TensorZero's privacy policy says it uses physical, technical, organizational, and administrative security measures to protect personal data. |
| Support | The pricing page lists email support for Pay as you go and dedicated support with custom SLAs for Enterprise. | The project README directs users to Slack or Discord and offers work teams a Slack or Teams channel by email. |
Plans
In their own words
Requesty
Requesty is a managed AI gateway that gives applications access to more than 600 models through one API. Its OpenAI-compatible API can work with existing SDK code after changing the base URL and API key. Routing features include policy and regional rules, automatic failover and load balancing. Requesty tracks cost, latency and usage, with analytics by model, user and team. Governance options include PII detection and scrubbing, content guardrails, team roles, model allowlists and audit logs. Named integrations include OpenAI, LangChain, PydanticAI, Vercel AI SDK, Haystack and LlamaIndex TS; the integrations page also lists tools such as Claude Code, Cline, VS Code, GitHub Copilot, Codex, n8n, LibreChat and OpenWebUI. The Free plan costs nothing and allows 200 requests per day. Pay as you go costs $5 a month, with a 5% markup on model cost. Enterprise pricing is custom. Requesty is available via API and web; self-hosting is not offered.
TensorZero
TensorZero is a free, open-source stack that brings together an LLM gateway, observability, optimization, evaluation, and experimentation. Its gateway provides a unified API for model providers and supports routing, retries, fallbacks, prompt templates, schemas, multi-step workflows, and traffic routing for A/B tests. Documented integrations include Anthropic, AWS Bedrock, Azure, Google, OpenAI, OpenRouter, Together AI, vLLM, xAI, and OpenAI-compatible endpoints. Inference and feedback data go to the database you configure, where they can be queried with SQL; feedback can be tied to individual inferences or episodes. The gateway and UI can run through Docker, Docker Compose, Kubernetes and Helm, or a source build. API key authentication is available for gateway endpoints other than status and health checks. The project is available on GitHub, but is no longer maintained; its repository is archived and read-only. TensorZero is self-hosted and licensed under Apache 2.0. It collects pseudonymous aggregate usage analytics, excluding application data and inference inputs and outputs, with an option to disable collection.