Skip to content
SPECIFICTION
Get listed

agentgateway

agentgateway.dev

Free plan Open source WebWindowsmacOSLinuxAPISelf-hosted
Visit agentgateway.dev
Spec score 9.1 #1 of 28 in Kubernetes Ingress Controllers

What it is

Agentgateway is a free, open-source HTTP and gRPC gateway for routing, securing, observing, and governing service, LLM, MCP, and agent-to-agent traffic. Its LLM gateway offers an OpenAI-compatible API for providers including OpenAI, Anthropic, Bedrock, Gemini, Vertex, and OSS Llama runs. Self-hosted inference routing supports vLLM, TGI, and Triton, with choices guided by latency, cost, and model. For MCP it supports server discovery, scoped tool calls, and audit trails; A2A routing connects runtimes such as LangChain, CrewAI, and ADK. Security features include JWT and OIDC, API keys, authorization policies, TLS and mTLS with certificate rotation, and rate limiting. Guardrails inspect MCP calls and responses for prompt injection and unsafe payloads, while prompt guards support checks and redaction. Observability includes OpenTelemetry, Prometheus token-usage histograms, Jaeger traces, and request logs with latency, token counts, and realized USD cost. It can run as a standalone binary, in Docker, or on Kubernetes. Commercial support is listed through a partner.

Spec sheet

What it does
Agentgateway is a Rust data plane that connects, secures, routes and observes LLM, MCP, A2A and ordinary service traffic.Read 19 Oct 2026 · agentgateway.dev
Purpose
Agentgateway is an open-source HTTP and gRPC gateway for routing, securing, observing, and governing service, LLM, MCP, and agent-to-agent traffic.Read 2 Oct 2026 · agentgateway.dev
Intended users
The site invites tool-builders, platform engineers, and AI enthusiasts to join the community and describes the controls as suited to platform teams.Read 2 Oct 2026 · agentgateway.dev
Deployment
The project provides standalone binary, Docker and Kubernetes deployment paths.Read 19 Oct 2026 · agentgateway.dev
Integrations
Official integration categories cover identity providers, AWS, Google Cloud, Azure, LLM providers, MCP, networking tools, agent frameworks and NetBird.Read 19 Oct 2026 · agentgateway.dev
Security
Listed security features include JWT and OIDC, API keys, authorization policies, TLS and mTLS with certificate rotation, and rate limiting.Read 2 Oct 2026 · agentgateway.dev
Support
The enterprise page lists partner-provided commercial support, including a Solo.io offer with 24×7 coverage, upstream collaboration, and best-practice guidance.Read 2 Oct 2026 · agentgateway.dev
A2A support
The A2A gateway supports capability discovery, modality negotiation and long-running task collaboration between agents.Read 19 Oct 2026 · agentgateway.dev
API and configuration
Standalone deployments use flat YAML configuration, while Kubernetes deployments use a controller, Gateway API resources and documented API references.Read 19 Oct 2026 · github.com
Authentication
Documented authentication methods include JWT, API keys, basic authentication and MCP authentication specifications.Read 19 Oct 2026 · agentgateway.dev
Authorization
Fine-grained authorization uses role-based policies and the CEL expression engine.Read 19 Oct 2026 · agentgateway.dev
Binary installation
The official installer is a curl script that downloads a release binary, verifies its checksum and installs it into /usr/local/bin.Read 19 Oct 2026 · agentgateway.dev
Company origin
Solo.io originally created agentgateway and donated it to the Linux Foundation in August 2025.Read 19 Oct 2026 · linuxfoundation.org
Cost controls
Virtual keys, token and dollar caps, model cost catalogs and dashboards attribute and enforce agent spending.Read 19 Oct 2026 · agentgateway.dev
Documentation
Documentation is split into standalone and Kubernetes sites with quickstarts, integration guides, configuration references and API documentation.Read 19 Oct 2026 · github.com
Enterprise support
Solo Enterprise for agentgateway advertises 24×7 coverage, upstream collaboration and operational guidance.Read 19 Oct 2026 · agentgateway.dev
Guardrails
Guardrails include regex checks, OpenAI moderation, AWS Bedrock Guardrails, Google Model Armor and custom webhooks.Read 19 Oct 2026 · github.com
Inference
Self-hosted inference routing supports vLLM, TGI, and Triton, with latency-aware, cost-aware, and model-aware routing.Read 2 Oct 2026 · agentgateway.dev
Inference routing
Kubernetes Inference Gateway extensions route self-hosted models using GPU utilization, KV-cache use, LoRA adapters and work-queue depth.Read 19 Oct 2026 · agentgateway.dev
Licence
The open-source project is licensed under Apache-2.0.Read 19 Oct 2026 · github.com
Limit: fast-changing configuration
An independent review cautioned that the project is actively developing and its configuration surface is not yet stable.Read 19 Oct 2026 · hysenlabs.com
Limit: insecure defaults
A hands-on review found optional API-key authentication, fail-open deny expressions and an unauthenticated localhost admin interface as defaults requiring hardening.Read 19 Oct 2026 · aitamer.news
Limit: operational complexity
A reviewer said the Kubernetes controller and policy model add too much machinery for a single service with one model provider and a fixed tool list.Read 19 Oct 2026 · mrkeyoor.com
LLM gateway
It offers one OpenAI-compatible interface for providers including OpenAI, Anthropic, Gemini and Bedrock, with budgets, failover and load balancing.Read 19 Oct 2026 · github.com
LLM routing
Its LLM gateway provides an OpenAI-compatible API for providers including OpenAI, Anthropic, Bedrock, Gemini, Vertex, and OSS Llama runs.Read 2 Oct 2026 · agentgateway.dev
Maker company facts
Solo.io is listed on LinkedIn as founded in 2017, headquartered in Cambridge, Massachusetts, with 51–200 employees.Read 19 Oct 2026 · linkedin.com
Maker legal name
Crunchbase lists the maker as solo.io, Inc.Read 19 Oct 2026 · crunchbase.com
MCP and A2A
The gateway supports MCP server discovery, scoped tool calls and audit trails, and A2A routing between LangChain, CrewAI, ADK, and other runtimes.Read 2 Oct 2026 · agentgateway.dev
MCP federation
It aggregates multiple MCP servers behind one endpoint and supports stdio, HTTP/SSE and Streamable HTTP transports.Read 19 Oct 2026 · agentgateway.dev
Notable release
Release notes document OAuth token exchange using RFC 8693 and RFC 7523 plus new Microsoft Entra ID, Descope and authentik MCP authentication providers.Read 19 Oct 2026 · github.com
Observability
Built-in observability exports OpenTelemetry metrics, logs and distributed traces.Read 19 Oct 2026 · agentgateway.dev
OpenAPI integration
Existing REST APIs can be exposed as MCP-native tools through OpenAPI integration.Read 19 Oct 2026 · agentgateway.dev
Praise: build quality
A review reported a successful clean build and 78 passing project tests in its sandbox evaluation.Read 19 Oct 2026 · mrkeyoor.com
Praise: MCP capabilities
An independent hands-on review praised first-class MCP support, per-caller tool filtering, multiplexing, stdio-to-HTTP bridging and OpenAPI conversion.Read 19 Oct 2026 · aitamer.news
Praise: unified gateway
An independent reviewer praised the single component for combining MCP federation, model routing, A2A traffic, policy and telemetry.Read 19 Oct 2026 · hysenlabs.com
Project milestone
The project reported one million image pulls in the quarter before its March 25, 2026 first-birthday article.Read 19 Oct 2026 · agentgateway.dev
Project stewardship
The enterprise page says agentgateway was originally created by Solo.io and is an AAIF project.Read 2 Oct 2026 · agentgateway.dev
Provider compatibility
OpenAI-compatible routing supports Cohere, Mistral, Groq, Together AI, Fireworks, Meta, Ollama, LM Studio, vLLM, llama.cpp and custom endpoints.Read 19 Oct 2026 · agentgateway.dev
Rating on Gartner Peer Insights
No user rating or review count is shown on the product page.Read 19 Oct 2026 · gartner.com
Rating on GetApp
No rating shown from 0 reviews.Read 19 Oct 2026 · getapp.com
Self-hosting
Agentgateway is designed to run on bare metal, virtual machines, containers or Kubernetes.Read 19 Oct 2026 · agentgateway.dev

Plans and prices

agentgateway (open source) Free Open-source gateway; binary, Docker, or Kubernetes deployment Read 2 Oct 2026 · agentgateway.dev

Every agentgateway plan and price →

Strong points and limits

Strong points

  • OpenAI-compatible API covers multiple listed model providers.
  • Supports MCP discovery, scoped calls, and audit trails.
  • Includes rate limiting, authorization policies, and TLS or mTLS.
  • Deploys as a binary, Docker container, or Kubernetes workload.

Limits

  • Deployment is self-hosted.
  • Commercial support is listed through a partner.

Who it suits

It suits tool-builders, platform engineers, and AI enthusiasts working with service, model, MCP, or agent traffic. Its controls are also described as suited to platform teams.

Verdict

Agentgateway brings routing, security controls, guardrails, and observability to several kinds of AI and service traffic. It is a self-hosted open-source option, with commercial support described through a partner.

Where Specifiction places it

Alternatives to agentgatewayAll alternatives →