An LLM gateway isn't a control plane if agents can bypass it entirely

Arc_bong · reddit · 2026-09-09

The author argues that LLM gateways (LiteLLM, Portkey, OpenRouter) only govern traffic that passes through them—agents with credentials and network access can call model APIs, MCP endpoints, or external services directly, at which point the gateway still routes traffic but no longer governs the agent.

Key points:

The author closes by asking practitioners what actually prevents bypass in production, beyond what architecture diagrams claim.

Related event: Agents Can Bypass LLM Gateways, Undermining Control-Plane Claims(2 posts)→

Original post →

More from coding & agent

coding & agent channel →