Specifiction
For vendors
AdvertiseTop spots, featured rows, home sponsor Get listedAdd a product we don't cover yet Claim a listingFree: verify the domain, then correct your page Vendor dashboardNumbers, orders and placements
List your tool
Vendor dashboard
Tech riderRev. 21 Sept 2026

TensorZero

Ch 146.6of 33 LLM Gateway Software
  1. 1Runs onAPI, Linux, self-hosted, Web
  2. 2CostsNot stated by the maker
  3. 3Fallback routingYes
  4. 4Usage analyticsYes
  5. 5Self-hosted deploymentYes
  6. 6Budget controlsYes
  7. 7Virtual API keysYes
6 lines stated Written from the maker's own pages: tensorzero.com
Visit site Alternatives
The TensorZero homepage

Overview

TensorZero is ranked #14 of 33 in LLM gateway software on Specifiction. It runs on API, Linux, Self-hosted, Web.

Compared on LLM gateway software

Free plan
Yestensorzero.com
Fallback routing
Yestensorzero.com
Usage analytics
Yestensorzero.com
Self-hosted deployment
Yestensorzero.com
Budget controls
Yestensorzero.com
Virtual API keys
Yestensorzero.com

Facts

Current status
The homepage says TensorZero remains available on GitHub but is no longer maintained.tensorzero.com · 7 Oct 2026
Product
TensorZero is described in its documentation as an open-source stack combining an LLM gateway, observability, optimization, evaluation, and experimentation.tensorzero.com · 7 Oct 2026
Gateway
The gateway provides a unified API for major LLM providers, with fallbacks and reported sub-millisecond P99 latency overhead under extreme load.tensorzero.com · 7 Oct 2026
Observability
The gateway stores inference and feedback data in the configured database for observability, experimentation, and optimization.tensorzero.com · 7 Oct 2026
Model integrations
Documented providers include Anthropic, AWS Bedrock, Azure, Google AI Studio, OpenAI, OpenRouter, vLLM, and xAI; OpenAI-compatible APIs are also supported.tensorzero.com · 7 Oct 2026
Experiments and workflows
The gateway supports multi-step workflows and traffic routing for A/B tests, with feedback assignable to individual inferences or episodes.tensorzero.com · 7 Oct 2026
Deployment
The gateway and UI can be deployed with Docker, Docker Compose, or Kubernetes and Helm, or built from source.tensorzero.com · 7 Oct 2026
Data control
TensorZero documentation says it stores its data in the user's own database, which can be queried directly with SQL.tensorzero.com · 7 Oct 2026
Security
The gateway supports API key authentication, which can be enabled to protect its endpoints other than status and health checks.tensorzero.com · 7 Oct 2026
License
The FAQ describes TensorZero as open source under the Apache 2.0 License.tensorzero.com · 7 Oct 2026
Support
The documentation directs users to Slack or Discord for questions and offers a team Slack or Teams channel by email.tensorzero.com · 7 Oct 2026
Notable limitation
The FAQ says TensorZero had no revenue model at the time described and planned a managed service for the future; the current homepage says the project is no longer maintained.tensorzero.com · 7 Oct 2026
Company
The FAQ describes the team as based in New York City and names Viraj Mehta and Gabriel Bianconi as its founders.tensorzero.com · 7 Oct 2026

Best TensorZero alternatives

See all 20
All accessCh 01 Bifrost Free planFree trialAPI Free to start7.7 All accessCh 02 Kong Gateway Free planFree trialAPI Free to start7.6 All accessCh 03 YoloRouter Free planAPILinux Free to start7.4 All accessCh 04 Requesty Free planFree trialAPI from $5/mo7.3 All accessCh 05 TrueFoundry AI Gateway Free planFree trialAPI from $25/mo7.3 All accessCh 06 Helicone Free planFree trialAPI from $79/mo7.2

Where it ranks on Specifiction

Is TensorZero yours?

Claim it for free: prove the domain, then correct facts, plans and screenshots. An editor reviews every change.

Claim it free Promote TensorZero

Sources