Providers gaming OpenRouter price sort via cached token markups, dev warns
rickasaurus · x · 2026-11-19
Developer rickasaurus warns that LLM providers are gaming OpenRouter's default "sort by price" ranking: they list low headline prices but gouge users on cached tokens.
His fix: build a custom sort based on your own usage pattern (e.g. how often you hit cache) instead of relying on the default price ranking, so you pick the provider that's actually cheapest for your workload.
More from Infra
- Developers push back against the thin-client future: 'ram altman doesn't want you to have RAM' — sull · 2026-11-19
- Nvidia interim CEO moves up raises and equity after Huang's ouster — rohanpaul_ai · 2026-11-19
- Weaviate 1.40 ships Enterprise and Platform editions with shard self-recovery — CShorten30 · 2026-11-19
- Why your fine-tuning job takes longer than the FLOPs say — Hugging Face Blog · 2026-11-19
- Nvidia raises FY2028 outlook but shares fall 2% as analysts flag 2028-29 slowdown risk — TiernanRayTech · 2026-11-19
- The hardest local LLM failures are the ones that look like success — FulcraDynamics · 2026-11-19