LLM Gateway vs Routerly

LLM Gateway provides one OpenAI-compatible API for routing requests among more than 250 models from over 40 providers. If a provider errors, times out, or rate-limits a request, it can retry up to twice with another provider for the same model. Its dashboard tracks request, token, spend, latency, error, and cache metrics, with model and provider breakdowns. Teams can use their own provider API keys without a platform fee and pay providers directly. The open-source core is licensed under AGPLv3 and can be self-hosted for free; enterprise features require a license. The Free plan is free, billed free forever, and has a 5% fee on credit usage. It includes 200+ models across 40+ providers, activity logs and export, and 20 requests per minute on free models; paid models are not rate limited. Enterprise pricing is custom and not listed. It includes custom routing, unlimited data retention, a 99.9% uptime SLA, and 24/7 priority support. Published integration guides cover tools including Claude Code, Cursor, Codex CLI, Cline, n8n, and VS Code.

Routerly is a self-hosted gateway for directing application requests to AI providers, tracking usage costs, and applying budgets. Its routing engine can use up to nine configurable policies, covering model choice, cost, provider health and performance, capability and context, budgets, rate limits, and fairness. It supports OpenAI and Anthropic wire formats, including streaming, so compatible clients can connect by changing the base URL. Listed providers include OpenAI, Anthropic, Google Gemini, Ollama, Mistral, Cohere, xAI, and custom HTTP endpoints. Per-token costs can use built-in pricing presets or custom model prices. Budgets can measure cost, calls, or token usage globally, per project, or per token, over rolling or calendar windows. Projects can have separate bearer tokens, model pools, routing configurations, and budget limits. Routerly stores configuration and usage records in JSON files without requiring an external database. It can be deployed with Docker or an installer. The self-hosted plan costs nothing, carries the AGPL-3.0 license, and adds no markup to API calls.