Skip to content
SPECIFICTION
Get listed

Routerly

routerly.ai

Free plan WebWindowsmacOSLinuxAPISelf-hosted
Visit routerly.ai
Spec score 8.0 #14 of 33 in LLM gateways

What it is

Routerly is a self-hosted gateway for directing application requests to AI providers, tracking usage costs, and applying budgets. Its routing engine can use up to nine configurable policies, covering model choice, cost, provider health and performance, capability and context, budgets, rate limits, and fairness. It supports OpenAI and Anthropic wire formats, including streaming, so compatible clients can connect by changing the base URL. Listed providers include OpenAI, Anthropic, Google Gemini, Ollama, Mistral, Cohere, xAI, and custom HTTP endpoints. Per-token costs can use built-in pricing presets or custom model prices. Budgets can measure cost, calls, or token usage globally, per project, or per token, over rolling or calendar windows. Projects can have separate bearer tokens, model pools, routing configurations, and budget limits. Routerly stores configuration and usage records in JSON files without requiring an external database. It can be deployed with Docker or an installer. The self-hosted plan costs nothing, carries the AGPL-3.0 license, and adds no markup to API calls.

Spec sheet

Product
Routerly is a self-hosted gateway between applications and AI providers that routes requests, tracks costs, and enforces budgets.Read 30 Sep 2026 · routerly.ai
Intended users
The site describes Routerly as built for developers and use cases ranging from indie projects to enterprise deployments, including SaaS teams and local-first development.Read 30 Sep 2026 · routerly.ai
Deployment
The maker provides Docker and installer-based deployment, and says the installer supports Windows, macOS, and Linux.Read 30 Sep 2026 · routerly.ai
Integrations
The site names Cursor, Open WebUI, OpenClaw, LangChain, and LlamaIndex as clients or frameworks that can connect to Routerly.Read 30 Sep 2026 · routerly.ai
Security
The documentation says provider API keys and project tokens are AES-256 encrypted at rest, and user passwords are bcrypt-hashed.Read 30 Sep 2026 · doc.routerly.ai
API compatibility
It supports OpenAI and Anthropic wire formats with streaming, so clients can use Routerly by changing the base URL.Read 30 Sep 2026 · routerly.ai
Budget controls
Budgets can be set globally, per project, or per token, and can track cost, calls, or token usage over rolling or calendar windows.Read 30 Sep 2026 · doc.routerly.ai
Cost tracking
Routerly tracks per-token costs and supports built-in pricing presets and custom model pricing.Read 30 Sep 2026 · routerly.ai
Data handling
Routerly is self-hosted, and its maker says prompts and API keys stay on the user's infrastructure.Read 30 Sep 2026 · blog.routerly.ai
License and pricing
Routerly is free to self-host under the AGPL-3.0 license, and the site says it adds no markup to API calls.Read 30 Sep 2026 · routerly.ai
Project isolation
Each project can have separate Bearer tokens, model pools, routing configuration, and budget limits.Read 30 Sep 2026 · routerly.ai
Providers
Supported providers include OpenAI, Anthropic, Google Gemini, Ollama, Mistral, Cohere, xAI, and custom HTTP endpoints.Read 30 Sep 2026 · routerly.ai
Routing
Its routing engine uses up to nine configurable policies, including LLM selection, cost, health, performance, capability, context, budget, rate limits, and fairness.Read 30 Sep 2026 · blog.routerly.ai
Storage and dependencies
Routerly stores configuration and usage records in JSON files and does not require an external database.Read 30 Sep 2026 · doc.routerly.ai

Plans and prices

Free self-hosted Free Free · Self-hosted · No markup on API calls · AGPL-3.0 Read 30 Sep 2026 · routerly.ai

Every Routerly plan and price →

Strong points and limits

Strong points

  • Supports OpenAI and Anthropic wire formats with streaming.
  • Offers up to nine configurable routing policies.
  • Budgets can track costs, calls, or token usage.
  • Stores records in JSON without an external database.
  • Free self-hosting under AGPL-3.0; no API-call markup.

Limits

  • Self-hosted deployment is required.
  • Free trial is not offered.
  • Prompts and API keys remain on the user's infrastructure.

Who it suits

Routerly suits developers and teams that want to manage AI-provider routing, costs, and budgets on their own infrastructure. Its project separation and configurable policies may fit uses from indie projects to enterprise deployments.

Verdict

Routerly combines provider routing with per-token cost tracking and flexible budget controls in a self-hosted package. Its free price is clear, but teams need to operate it on their own infrastructure.

Where Specifiction places it

Alternatives to RouterlyAll alternatives →