OpenRouter rebuilds provider routing: 46% fewer capacity errors, 16.9% faster TTFT
steipete · x · 2026-10-30
OpenRouter announced its biggest routing algorithm upgrade ever, replacing price-only routing with a blend of realized price, latency, throughput, and error rate per endpoint. Results: TTFT improved 16.9%, throughput 16.3%, capacity errors down 46%, at only 6% higher cost. Routing stays cache-aware, traffic shifts away from failing endpoints in real time, and no code changes are needed. steipete notes unpredictable inference quality was why he used to recommend skipping the middleman.
Related event: OpenRouter Rewrites Routing Algorithm, Cutting Errors and Latency(2 posts)→
More from coding & agent
- effect-harness on Cloudflare: run agent loops, tools and credentials on separate VMs — samgoodwin89 · 2026-10-31
- jh3yy: agents gave me flow state — my tools finally keep up with my brain — jh3yy · 2026-10-31
- CAFE ecosystem: Maple moves 300k lines of React to Foldkit in 3 days — samgoodwin89 · 2026-10-31
- Non-coder builds 100-star Android TV launcher entirely with Claude — SuB8u · 2026-10-31
- Factory acquires typedef_ai to give coding agents an enterprise data context layer — maddiehfaulkner · 2026-10-31
- Browser agent's graph reroute wins 5/5 vs 0/5 for trajectory replay, author retracts own number — JeremyCMorgan · 2026-10-31