OpenRouter ships biggest router overhaul: traffic now rewards quality-per-cost, not price
QuixiAI · x · 2026-10-31
OpenRouter has shipped its biggest provider-routing overhaul since founding, with co-founder Alex Atallah citing months of research and testing.
- Old logic: traffic was prioritized mostly by price.
- New logic: endpoints compete on quality per actual cost, weighing cache-adjusted effective price, TTFT, end-to-end TPS, failed/broken responses and 429 rate-limit rates.
- Allocation: endpoints fall inside a competitive edge (most traffic) or an exploration zone (fast-decaying share, but guaranteed minimum traffic to detect improvement); each request is randomly routed weighted by share, with retries drawn from remaining endpoints.
- Breaker & caps: traffic pauses if reliability/quality/429 signals fall far below peers.
The design aims to automatically reward better providers with more traffic, creating a continuous-improvement incentive loop.
Related event: OpenRouter Overhauls Routing Algorithm, Prioritizing Quality per Cost(4 posts)→
More from Infra
- Together Compiler: agent-driven continual compilation for AI inference — togethercompute · 2026-11-12
- Kaspersky details Black Owl APT breach of software vendor eyeing supply-chain attack — cyb3rops · 2026-11-12
- Speculative decoding draft models for Qwen3-8B compared: WhiFlash vs Tengyunw benchmarks — maxsloef · 2026-11-12
- AMD runs MolmoAct2 robot policy locally on a Ryzen AI Max+ 395 mini PC — DJiafei · 2026-11-12
- Opinion: AI infra is becoming a coding runtime as intelligence units outgrow tokens — prateekj · 2026-11-12
- PrefixRelay: open-source proxy gives Cursor 97%+ KV cache hits on local models — jjusko20 · 2026-11-12