ngrok launches AI Gateway: route self-hosted and frontier models through one managed URL
anthara_ai · x · 2026-09-05
ngrok launched AI Gateway (GOPHRS), a managed gateway unifying self-hosted and frontier provider models: swap your baseURL to gateway.ngrok.ai, change the API key, and it works with OpenAI, Anthropic, and Vercel AI SDKs.
Key capabilities:
- Smart routing and fallback: route to a self-hosted model (e.g. local Qwen GGUF) first, falling back to gpt-5.4, claude-opus, or other public providers
- Local LLM connectivity over private links, no public IPs or inbound ports
- BYOK key management: keep your existing provider keys and rates, with scoped per-app/per-dev keys controlling model access
- Observability: token, latency, error and cost rollups across apps, devs, and models
The company says the architecture is final, pitching it as "never bet on one model" multi-model routing.
Related event: ngrok launches AI Gateway: one URL to route cloud and self-hosted models(7 posts)→
More from coding & agent
- Screenshot table to Excel in PowerShell: LLM only locates, code does the rest — dfinke · 2026-10-21
- One line of PowerShell turns any screenshot table into real Excel data in 4 seconds — dfinke · 2026-10-21
- Screenshot to spreadsheet in 4 seconds with one line of PowerShell — dfinke · 2026-10-21
- A mitm proxy that rewrites robots.txt to Allow: all gets you really far — generativist · 2026-10-21
- Anaconda ships MCP to stop coding agents from hallucinating malicious dependency packages — anacondainc · 2026-10-21
- 5-person team uses Claude and 300+ agents to design 318,484 proteins in 64 hours — 141_1337 · 2026-10-21