agentgateway vs ToolRoute

Agentgateway is a free, open-source HTTP and gRPC gateway for routing, securing, observing, and governing service, LLM, MCP, and agent-to-agent traffic. Its LLM gateway offers an OpenAI-compatible API for providers including OpenAI, Anthropic, Bedrock, Gemini, Vertex, and OSS Llama runs. Self-hosted inference routing supports vLLM, TGI, and Triton, with choices guided by latency, cost, and model. For MCP it supports server discovery, scoped tool calls, and audit trails; A2A routing connects runtimes such as LangChain, CrewAI, and ADK. Security features include JWT and OIDC, API keys, authorization policies, TLS and mTLS with certificate rotation, and rate limiting. Guardrails inspect MCP calls and responses for prompt injection and unsafe payloads, while prompt guards support checks and redaction. Observability includes OpenTelemetry, Prometheus token-usage histograms, Jaeger traces, and request logs with latency, token counts, and realized USD cost. It can run as a standalone binary, in Docker, or on Kubernetes. Commercial support is listed through a partner.

ToolRoute has no write-up on Specifiction yet; its figures are above.