Skip to content
SPECIFICTION
Get listed

LLM Gateway Software

Alternatives to Cloudflare AI Gateway

The tools Specifiction weighs against Cloudflare AI Gateway, from its list of llm gateway software, each with its plans, platforms and spec score.

  1. 01 LangSmith

    LangSmith suits teams engineering AI agents that need evaluation, tracing, prompt work, deployment, and production monitoring.

    From $39/mo Free plan Web · Windows · macOS · Linux
    9.2 Visit Specs
  2. 02 Bifrost

    The OSS edition suits developers and small teams managing their own deployment.

    Free plan Open source Web · Windows · macOS · Linux
    9.0 Visit Specs
  3. 03 Eden AI

    Eden AI suits companies that want to test, compare, or switch among AI providers through one API rather than integrating each separately.

    Free plan Web · API
    9.0 Visit Specs
  4. 04 Manifest

    Manifest suits AI builders, teams, startups, and platforms managing model access and inference consumption.

    From $19/mo Free plan Open source Web · Linux · API · Self-hosted
    9.0 Visit Specs
  5. 05 LLM Gateway

    LLM Gateway suits product and platform teams routing requests across model providers, including teams that want to self-host the open-source core.

    Free plan Open source Web · Linux · API · Self-hosted
    8.7 Visit Specs
  6. 06 TrueFoundry AI Gateway

    It suits teams that need a common interface for model access, routing, usage monitoring, and controls.

    From $25/mo Free plan Web · Linux · API · Self-hosted
    8.7 Visit Specs
  7. 07 Envoy AI Gateway

    It suits teams sharing models or tools that need centralized credentials, quotas, usage attribution, or failover.

    Free plan macOS · Linux · API · Self-hosted
    8.4 Visit Specs
  8. 08 Helicone

    Helicone suits teams routing and observing AI application requests across model providers, including teams that need self-hosting or LLM cost tracking.

    From $79/mo Free plan Web · API · Self-hosted
    8.3 Visit Specs
  9. 09 Requesty

    Requesty may suit developers and teams that want one gateway for model access, routing and usage visibility.

    Free plan Web · API · Browser extension
    8.3 Visit Specs
  10. 10 YoloRouter

    YoloRouter suits teams already shipping AI features that need multi-provider access, failover, cost controls, quotas, or request visibility.

    Free plan Open source Web · Windows · macOS · Linux
    8.2 Visit Specs
  11. 11 SGLang

    SGLang suits developers and infrastructure teams serving language, vision-language or diffusion models on varied accelerators.

    Free plan macOS · Linux · API · Self-hosted
    8.1 Visit Specs
  12. 12 TensorZero

    TensorZero may suit developers who want a self-hosted LLM gateway and data stored in their own database.

    Free plan Web · Linux · API · Self-hosted
    8.0 Visit Specs
  13. 13 Cortecs
    From €5/mo Web · API
    7.8 Visit Specs
  14. 14 LiteLLM

    LiteLLM is aimed at platform teams that need a shared gateway, model routing and spend controls.

    Free plan Web · API · Self-hosted
    7.8 Visit Specs
  15. 15 Routerly

    Routerly suits developers and teams that want to manage AI-provider routing, costs, and budgets on their own infrastructure.

    Free plan Web · Windows · macOS · Linux
    7.8 Visit Specs
  16. 16 OpenRouter
    Free plan Web · API
    7.7 Visit Specs
  17. 17 Orq.ai

    Orq.ai is aimed at engineering and product teams building and shipping LLM applications together.

    Free plan Web · API · Self-hosted
    7.7 Visit Specs
  18. 18 Vercel

    Vercel suits teams deploying web applications from connected Git repositories and using its listed frameworks and delivery infrastructure.

    From $20/mo Free plan Web · API
    7.7 Visit Specs
  19. 19 WSO2 AI Gateway

    It suits teams that need to govern AI APIs or generative AI services and manage usage, prompts, and safety controls.

    From $119/mo Free trial Web · Windows · macOS · Linux
    7.7 Visit Specs
  20. 20 Apache APISIX

    APISIX suits teams that need a self-managed gateway for APIs, microservices or LLM workloads.

    Linux · API · Self-hosted
    7.6 Visit Specs
  21. 21 Polyrouter
    Free plan Web · API · Self-hosted
    7.6 Visit Specs
  22. 22 UniterRouter
    From $41.67/mo Free plan Web · API
    7.6 Visit Specs
  23. 23 Inference Gateway
    Web · Windows · macOS · Linux
    7.5 Visit Specs
  24. 24 Ramp Router
    Free plan Web · API
    7.5 Visit Specs
  25. 25 Tyk AI Studio Proxy
    Free plan Web · API · Self-hosted
    7.5 Visit Specs
  26. 26 ZenMux
    From $20/mo Free plan Web · API
    7.5 Visit Specs
  27. 27 OpenZiti LLM Gateway
    Windows · macOS · Linux · API
    7.4 Visit Specs
  28. 28 Martian Gateway
    Web · API
    7.3 Visit Specs
  29. 29 Prisma AIRS AI Gateway
    Web · API · Self-hosted
    7.2 Visit Specs
  30. 30 vLLM Semantic Router
    macOS · Linux · API · Self-hosted
    7.2 Visit Specs

Cloudflare AI Gateway, head to head