Local AI models improve 18x in accuracy per joule over 16 months, Stanford team says
Azaliamirh · x · 2026-09-12
Inference is going increasingly hybrid: a Stanford-affiliated team reports that accuracy per joule of local models improved 18x in just 16 months — 5.9x from hardware gains and 3.0x from model improvements. The work, by Azaliamirh, Avanika, Jon Saad-Falcon, Hazy Research and John Hennessy, was featured in a Financial Times deep-dive on the world's decreasing dependence on centralized cloud AI.
Related event: Stanford: Hybrid Local-Cloud Inference Cuts 60-80% of Compute Cost(3 posts)→
More from Infra
- SemiAnalysis: OpenAI reportedly negotiating ~1GW TPU commitment while seeking sites — dylan522p · 2026-10-28
- I tested 11 video upscaling methods for AI video: local, Topaz and cloud compared — lopas99 · 2026-10-28
- Thermo-backed CTO says AI is in its dial-up phase, touts disaggregated compute for an ultrafast 'broadband moment' — beffjezos · 2026-10-28
- DeepSeek-V4.1-Flash Q2 runs at 41 tok/s on one RTX 3090, 90% token match vs API — musicurgy · 2026-10-28
- USearch v3 RC ships after 1,000 days, its libraries now embedded in 550K-star projects — viglovikov · 2026-10-28
- SK Hynix says memory demand will outpace supply through 2030 — Chemical_Hawk_6307 · 2026-10-28