Higress vs Varnish Gateway

Higress is an open-source API gateway for governing AI services and cloud-native traffic, built on Istio and Envoy. Its AI Gateway provides centralized access to model APIs and MCP servers, with unified routing, protocol conversion, load balancing, and fallback. Higress says it supports more than 100 mainstream large language models. It can convert HTTP to MCP and proxy native MCP services. Traffic controls include token-based quotas and rate limits, API key pool rotation, and consumer authentication. Caching can reuse inference results precisely or semantically to reduce token use and latency for similar or repeated questions. Listed security measures cover prompt attacks, sensitive content, data privacy, and output filtering. The wider API gateway combines traffic, microservice, and security gateway functions with service exposure and API lifecycle management. It supports HTTP, HTTP2, HTTPS, GRPC, GRPCS, TCP, and Dubbo, along with Kubernetes Ingress and Gateway API. Custom Wasm plugins can be written in Go, Rust, or JavaScript, with sandbox isolation and hot updates. The self-hosted Community Edition is free; the site also lists a managed Alibaba Cloud plan billed by actual usage, starting at ¥0.

Varnish Gateway has no write-up on Specifiction yet; its figures are above.