Best LLM Gateway Software in 2026
Updated
33 LLM gateway software ranked on what their makers publish — plans and prices, free tiers, platforms and the facts on their own pages.
33ranked
0free plans on this page
8 Oct 2026last checked
Input list LLM Gateway Software 8 channels on this page · 37 of 64 spec lines stated by the makers
Ch Tool Free planPaid fromProvider countFallback routingUsage analyticsSelf-hosted deploymentBudget controlsVirtual API keys Spec sheet Score
26 Cloudflare AI Gateway Free planYesPaid fromnot statedProvider countnot statedFallback routingYesUsage analyticsYesSelf-hosted deploymentnot statedBudget controlsYesVirtual API keysnot stated 4/8spec lines stated 6.0
27 Inference Gateway Free planYesPaid fromnot statedProvider countnot statedFallback routingNoUsage analyticsYesSelf-hosted deploymentYesBudget controlsnot statedVirtual API keysnot stated 4/8spec lines stated 6.0
28 Kong AI Gateway Free planNoPaid fromnot statedProvider countnot statedFallback routingYesUsage analyticsYesSelf-hosted deploymentYesBudget controlsYesVirtual API keysYes 6/8spec lines stated 6.0
29 Cortecs Free plannot statedPaid fromnot statedProvider count10Fallback routingYesUsage analyticsYesSelf-hosted deploymentnot statedBudget controlsYesVirtual API keysnot stated 4/8spec lines stated 5.8
30 vLLM Semantic Router Free planYesPaid fromnot statedProvider countnot statedFallback routingNoUsage analyticsYesSelf-hosted deploymentYesBudget controlsnot statedVirtual API keysnot stated 4/8spec lines stated 5.8
31 ZenMux Free planYesPaid from$20/moProvider countnot statedFallback routingYesUsage analyticsYesSelf-hosted deploymentnot statedBudget controlsYesVirtual API keysnot stated 5/8spec lines stated 5.8
32 Envoy AI Gateway Free planYesPaid fromnot statedProvider countnot statedFallback routingYesUsage analyticsYesSelf-hosted deploymentYesBudget controlsYesVirtual API keysnot stated 5/8spec lines stated 5.7
33 Ramp Router Free planNoPaid fromnot statedProvider countnot statedFallback routingYesUsage analyticsYesSelf-hosted deploymentnot statedBudget controlsYesVirtual API keysYes 5/8spec lines stated 5.7
Compare all 8 in a table
| # | Tool | Score | Free plan | Free plan | Paid from | Provider count | Fallback routing |
|---|---|---|---|---|---|---|---|
| 26 | Cloudflare AI Gateway | 6.0 | No | Yes | — | — | Yes |
| 27 | Inference Gateway | 6.0 | No | Yes | — | — | No |
| 28 | Kong AI Gateway | 6.0 | No | No | — | — | Yes |
| 29 | Cortecs | 5.8 | No | — | — | 10 | Yes |
| 30 | vLLM Semantic Router | 5.8 | No | Yes | — | — | No |
| 31 | ZenMux | 5.8 | No | Yes | 20 /mo | — | Yes |
| 32 | Envoy AI Gateway | 5.7 | No | Yes | — | — | Yes |
| 33 | Ramp Router | 5.7 | No | No | — | — | Yes |
More in Developer Tools
All developer tools listsAccessibility Testing Software 168Log Management Software 107AI Coding Assistants 103Package Managers 93AI Agent Platforms 73Reverse Engineering Tools 73Software Composition Analysis Software 66Artifact repository software 64Browser Automation Tools 63Integrated Development Environments 63Code Playground Software 58Container Registries 56