agentgateway vs Inference Gateway
agentgateway
agentgateway.devInference Gateway
docs.inference-gateway.comSide by side
| Figure | agentgateway | Inference Gateway |
|---|---|---|
| Price from | Free | — |
| Free plan | Yes | — |
| Free trial | — | — |
| Open source | Yes | — |
| Web | Yes | Yes |
| Windows | Yes | Yes |
| macOS | Yes | Yes |
| Linux | Yes | Yes |
| API | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 1 | 0 |
| Spec score · Tool Calling | 9.1 (#3) | 7.5 (#13) |
| Authentication | Documented authentication methods include JWT, API keys, basic authentication and MCP authentication specifications. | Authentication supports OIDC identity providers, with JWT validation against the issuer’s JWKS. |
| Deployment | The project provides standalone binary, Docker and Kubernetes deployment paths. | The getting-started guide documents Docker, Docker Compose examples, and Kubernetes deployment. |
| Observability | Built-in observability exports OpenTelemetry metrics, logs and distributed traces. | Built-in observability includes Prometheus metrics, OTLP tracing, structured JSON logs, and reference Grafana dashboards. |
| Purpose | Agentgateway is an open-source HTTP and gRPC gateway for routing, securing, observing, and governing service, LLM, MCP, and agent-to-agent traffic. | Inference Gateway is an open-source, cloud-native proxy that provides one OpenAI-compatible API for multiple hosted and local LLM providers. |
Plans
In their own words
agentgateway
Agentgateway is a free, open-source HTTP and gRPC gateway for routing, securing, observing, and governing service, LLM, MCP, and agent-to-agent traffic. Its LLM gateway offers an OpenAI-compatible API for providers including OpenAI, Anthropic, Bedrock, Gemini, Vertex, and OSS Llama runs. Self-hosted inference routing supports vLLM, TGI, and Triton, with choices guided by latency, cost, and model. For MCP it supports server discovery, scoped tool calls, and audit trails; A2A routing connects runtimes such as LangChain, CrewAI, and ADK. Security features include JWT and OIDC, API keys, authorization policies, TLS and mTLS with certificate rotation, and rate limiting. Guardrails inspect MCP calls and responses for prompt injection and unsafe payloads, while prompt guards support checks and redaction. Observability includes OpenTelemetry, Prometheus token-usage histograms, Jaeger traces, and request logs with latency, token counts, and realized USD cost. It can run as a standalone binary, in Docker, or on Kubernetes. Commercial support is listed through a partner.
Inference Gateway
Inference Gateway has no write-up on Specifiction yet; its figures are above.