Burkov Slams OpenRouter Reliability: Fallback Models Fail Together
burkov · x · 2026-09-17
ML author Andriy Burkov criticized OpenRouter's reliability: even with a fallback chain across two open-weight models from different providers, both often fail at the same time. He questions why a company "supposedly worth billions" can't maintain a reliable fallback server for its most popular models.
More from Infra
- Idle models might be smarter: a musing on GEMV vs GEMM under low concurrency — karminski3 · 2026-09-17
- University of Memphis study finds no major air quality deterioration around xAI's Colossus 1 — TinfoilTricorn · 2026-09-17
- Beam moves ~1TB every 30 minutes six months after launching on Bittensor — markjeffrey · 2026-09-17
- VC-Attention: training-free low-bit attention hits 1.9x on B200, beating FlashAttention-4 — xiuyu_l · 2026-09-17
- mlx.fast fixes speed-display bug: MLX kernels hit 80.6 tps, nearing 100% speedup milestone — HankYeomans · 2026-09-17
- IBM NorthPole claims 22x inference performance over Nvidia on 12nm process — Site-Staff · 2026-09-17