Cloudflare AI Gateway vs LLM Gateway
Cloudflare AI Gateway
cloudflare.comLLM Gateway
llmgateway.ioSide by side
| Figure | Cloudflare AI Gateway | LLM Gateway |
|---|---|---|
| Price from | Free | Free |
| Free plan | Yes | Yes |
| Free trial | — | Yes |
| Open source | — | Yes |
| Web | Yes | Yes |
| Linux | — | Yes |
| API | Yes | Yes |
| Self-hosted | — | Yes |
| Plans published | 3 | 2 |
| Spec score · LLM Gateway Software | 8.7 (#5) | 8.7 (#6) |
| Spec score · LLM gateways | 7.9 (#18) | 9.1 (#3) |
| Analytics | The dashboard reports requests, tokens, costs, errors, cache-hit rates and performance across providers. | The dashboard tracks request, token, spend, latency, error, and cache metrics, with breakdowns by model and provider. |
| BYOK | Provider keys can be stored in Cloudflare's encrypted infrastructure, centrally rotated and used at request time. | Customers may store their own provider keys and use routing and analytics without a platform fee. |
| Caching | Responses can be served from Cloudflare's global cache, with configurable TTL and per-request controls; Cloudflare says latency can fall by up to 90% for repeated queries. | Projects can enable response caching to reduce repeated-request latency and token expense. |
| Company size | LinkedIn lists Cloudflare's company size as 1,001–5,000 employees. | LinkedIn classifies llm-gateway as a self-employed information-services organization with 2–10 employees. |
| Documentation depth | The documentation includes setup, provider guides, REST reference, bindings, integrations, features, limits, pricing, troubleshooting and a product changelog. | The documentation includes feature guides, dashboard knowledge-base articles, integration material, self-hosting sections, developer tools and an API reference. |
| Guardrails | Guardrails inspect prompts and model responses for harmful content and can flag or block configured categories. | Enterprise guardrails can detect prompt injection, jailbreak attempts, personally identifying information, payment-card data and secrets, with block, redact or warn actions. |
| Licence | The hosted AI Gateway service is not presented as an open-source project; an independent review notes there is no source project to self-host or patch. | The core gateway, dashboard, API and worker are released under AGPLv3, while code in the ee directory has commercial licensing. |
| Security compliance | Cloudflare publishes SOC 2 materials and states controls aligned to the AICPA Trust Services Criteria. | The trust center lists SOC 2 Type 2 as compliant and GDPR as in progress, with security policies, controls and a penetration-test document available. |
| What it does | Cloudflare AI Gateway is a managed control plane that routes AI application traffic through one gateway for visibility, controls, billing and logs. | LLM Gateway places one OpenAI-compatible API between applications and dozens of model providers, handling routing, credentials, usage and cost tracking. |
Plans
Cloudflare AI Gateway
- AI Gateway corePriced on request
- AI Gateway coreFree
- Cloudflare AI Gateway listingPriced on request
In their own words
Cloudflare AI Gateway
Cloudflare AI Gateway has no write-up on Specifiction yet; its figures are above.
LLM Gateway
LLM Gateway provides one OpenAI-compatible API for routing requests among more than 250 models from over 40 providers. If a provider errors, times out, or rate-limits a request, it can retry up to twice with another provider for the same model. Its dashboard tracks request, token, spend, latency, error, and cache metrics, with model and provider breakdowns. Teams can use their own provider API keys without a platform fee and pay providers directly. The open-source core is licensed under AGPLv3 and can be self-hosted for free; enterprise features require a license. The Free plan is free, billed free forever, and has a 5% fee on credit usage. It includes 200+ models across 40+ providers, activity logs and export, and 20 requests per minute on free models; paid models are not rate limited. Enterprise pricing is custom and not listed. It includes custom routing, unlimited data retention, a 99.9% uptime SLA, and 24/7 priority support. Published integration guides cover tools including Claude Code, Cursor, Codex CLI, Cline, n8n, and VS Code.