Benchmark: Agentgateway costs ~$280/yr at 5000 routes, rivals up to 182× more
bibryam · x · 2026-11-10
John Howard of agentgateway published new Gateway API benchmarks comparing 6 AI gateways.
- Reliability: Agentgateway passed all scenarios; Envoy Gateway and NGINX errored during route changes; Envoy/Istio/Kgateway let invalid routes block valid updates.
- Cost at scale: 5000 routes ≈ $280/year for Agentgateway vs $5K–$50K for alternatives (20–180× gap); NGINX hits $131,930 on ListenerSet scale.
- Stability: Traefik has cross-Gateway isolation issues and lacks ListenerSet support; NGINX deadlocks during config updates.
Full report, methodology, and reproducible tests are public.
More from Infra
- The math behind Anthropic's 5-minute and 1-hour prompt cache options — bigaiguy · 2026-11-10
- Why Send This to the Cloud? Resume Screening Runs Locally on an RTX Spark — draginol · 2026-11-10
- Signal65 MLPerf analysis: Azure GB300 tops DeepSeek-R1 interactive serving at 260k tokens/sec — ryanshrout · 2026-11-10
- Copy-from-document speculative decoding speeds AI extraction 4.7x (up to 19x) vs naive vLLM — sh_reya · 2026-11-10
- Compute is the first crux of AI takeoff: substitution estimates diverge wildly — austinc3301 · 2026-11-10
- CoreWeave Launches Claude Code Skill to Build GPU Clusters and Serve Models from the CLI — altryne · 2026-11-10