Google Cloud Endpoints vs Higress

Google Cloud Endpoints manages APIs with tools for securing access, monitoring activity, analyzing usage, and setting quotas. It supports API descriptions written in OpenAPI 2.0 or 3.x, as well as gRPC, and provides management through ESP or ESPv2. Documented deployment backends include Google Kubernetes Engine, Compute Engine, Kubernetes, App Engine, Cloud Run, Cloud Run functions, and Knative serving; proxy availability varies by backend. Endpoints is optimized for Docker and can host an API wherever Docker runs, provided it has internet access to Google Cloud. API keys can be required and validated to identify a Google Cloud project for quotas, billing, and monitoring. Documented user authentication options include Firebase Authentication and Auth0, using JWT validation by ESP. Logs and metrics are viewable in the Google Cloud console. Pricing depends on API calls and Service Control calls: the Free usage tier is free for 1,999,999 calls; Standard is $3 a month for 2,000,000 to 1,000,000,000; and High-volume is $1.50 a month for 1,000,000,000 and above. Listed rates are per million API calls.

Higress is an open-source API gateway for governing AI services and cloud-native traffic, built on Istio and Envoy. Its AI Gateway provides centralized access to model APIs and MCP servers, with unified routing, protocol conversion, load balancing, and fallback. Higress says it supports more than 100 mainstream large language models. It can convert HTTP to MCP and proxy native MCP services. Traffic controls include token-based quotas and rate limits, API key pool rotation, and consumer authentication. Caching can reuse inference results precisely or semantically to reduce token use and latency for similar or repeated questions. Listed security measures cover prompt attacks, sensitive content, data privacy, and output filtering. The wider API gateway combines traffic, microservice, and security gateway functions with service exposure and API lifecycle management. It supports HTTP, HTTP2, HTTPS, GRPC, GRPCS, TCP, and Dubbo, along with Kubernetes Ingress and Gateway API. Custom Wasm plugins can be written in Go, Rust, or JavaScript, with sandbox isolation and hot updates. The self-hosted Community Edition is free; the site also lists a managed Alibaba Cloud plan billed by actual usage, starting at ¥0.