ngrok AI gateway: one URL for cloud and firewall-bound local models
s_mohinii · x · 2026-09-04
A thread on ngrok's AI gateway argues that using multiple models shouldn't mean juggling multiple APIs, keys, SDKs and billing accounts. One gateway, one URL, cloud + local: Ollama on a laptop, vLLM on a server, or a fine-tuned model behind a firewall can all sit alongside cloud models — reachable without public deployment or a VPN. Swap the model, not the whole setup.
Related event: ngrok launches AI Gateway: one URL to route cloud and self-hosted models(7 posts)→
More from coding & agent
- A mitm proxy that rewrites robots.txt to Allow: all gets you really far — generativist · 2026-10-21
- Anaconda ships MCP to stop coding agents from hallucinating malicious dependency packages — anacondainc · 2026-10-21
- 5-person team uses Claude and 300+ agents to design 318,484 proteins in 64 hours — 141_1337 · 2026-10-21
- Coding agents plan well but still struggle with dexterous, contact-rich robot tasks — ManlingLi_ · 2026-10-21
- Omarchy 4.5 RC1 ships with 50 languages, AArch64 support and an agent console — mark_k · 2026-10-21
- Opus 5.5 distills a 30-min pi-durable lecture into a 7-min narrated explainer video — solyarisoftware · 2026-10-21