Why buy $20k local machines for GLM 5.3 at 70 TPS? OpenRouter ran all night for $10
TheZachMueller · x · 2026-10-11
greg bororu questions why people buy $20k local machines just to run GLM 5.3 at 70 TPS: 'I just used a random provider on OpenRouter, ran it all night and paid $10.' Zach Mueller quote-tweeted the take, sparking the local vs. API cost debate.
More from Infra
- Compaction tosses 262GB of KV cache to keep 20KB, says Muennighoff — Muennighoff · 2026-10-11
- Qwen3.8-Flash-Next on a 5090 beats Claude Code on airbench: 11 min vs 14 min — dh7net · 2026-10-11
- Google's AI lag may stem from too little compute for short-term research, argues LeClerc — robleclerc · 2026-10-11
- Local LLM field guide benchmarks 14 hardware configs for real-world token speed — NandoDF · 2026-10-11
- Data center bottleneck shifts from demand to permission: Oracle's Project Jupiter stumbles — Beth_Kindig · 2026-10-11
- Energy capacity equals economic capacity: a16z chart fuels AI infra debate — _rockt · 2026-10-11