ngrok Launches AI Gateway: One URL to Route Cloud and Local Models
anthara_ai · x · 2026-09-04
ngrok's new AI Gateway routes cloud and self-hosted models behind a single URL: swap baseURL and API key to use OpenAI/Anthropic/Vercel SDKs, with model fallback chains (local first, then frontier providers), BYOK with your existing rates, scoped per-app access keys, and unified observability for tokens, latency and cost. Local LLMs connect over private links, no public IPs needed.
Related event: ngrok launches AI Gateway: one URL to route cloud and self-hosted models(7 posts)→
More from coding & agent
- Burkov: if you don't interrogate Codex line-by-line at handoff, you get 80%-done work — burkov · 2026-10-21
- Mintlify launches Autopilot, an always-on agent that updates docs as you ship — stuffyokodraws · 2026-10-21
- Skills vs MCP vs RAG vs Memory: the four knowledge layers production agents need — MaryamMiradi · 2026-10-21
- When customer service bans AI agents, one goes incognito to fight Xfinity — MoonL88537 · 2026-10-21
- Every.to publishes raw interviews so readers can agent-check quotes in its Codex story — every · 2026-10-21
- One-prompt Blender: Voyager + Claude Opus 5.5 auto-connects to Blender and Unity — ravisparikh · 2026-10-21