TensorZero vs ZenMux
TensorZero
tensorzero.comZenMux
zenmux.aiSide by side
| Figure | TensorZero | ZenMux |
|---|---|---|
| Price from | Free | $20/mo |
| Free plan | Yes | Yes |
| Free trial | — | — |
| Open source | — | — |
| Web | Yes | Yes |
| Linux | Yes | — |
| API | Yes | Yes |
| Self-hosted | Yes | — |
| Plans published | 1 | 4 |
| Spec score · LLM gateways | 8.6 (#7) | 7.8 (#23) |
| Spec score · LLM Gateway Software | 8.0 (#13) | 7.5 (#27) |
| Integrations | Documented providers include Anthropic, AWS Bedrock, Azure, Google, OpenAI, OpenRouter, Together AI, vLLM, and OpenAI-compatible endpoints. | The subscription guide lists integrations for Claude Code, CodeX, Cline, VS Code Copilot, OpenCode, Cherry Studio, Obsidian, Dify, and Open WebUI. |
| Observability | TensorZero can store inference and feedback data for observability, optimization, evaluations, and experimentation in Postgres or ClickHouse. | The platform provides API request logs and analytics for costs, usage, and performance. |
| Support | The project README directs users to Slack or Discord and offers work teams a Slack or Teams channel by email. | ZenMux lists technical support by email and says it typically responds within 24 hours. |
Plans
In their own words
TensorZero
TensorZero is a free, open-source stack that brings together an LLM gateway, observability, optimization, evaluation, and experimentation. Its gateway provides a unified API for model providers and supports routing, retries, fallbacks, prompt templates, schemas, multi-step workflows, and traffic routing for A/B tests. Documented integrations include Anthropic, AWS Bedrock, Azure, Google, OpenAI, OpenRouter, Together AI, vLLM, xAI, and OpenAI-compatible endpoints. Inference and feedback data go to the database you configure, where they can be queried with SQL; feedback can be tied to individual inferences or episodes. The gateway and UI can run through Docker, Docker Compose, Kubernetes and Helm, or a source build. API key authentication is available for gateway endpoints other than status and health checks. The project is available on GitHub, but is no longer maintained; its repository is archived and read-only. TensorZero is self-hosted and licensed under Apache 2.0. It collects pseudonymous aggregate usage analytics, excluding application data and inference inputs and outputs, with an option to disable collection.