Sam Altman: local inference is a terrible allocation of the world's scarce DRAM
TheZachMueller · x · 2026-10-30
Sam Altman pushed back on the popular intuition that open-source models have "solved" local inference. From a global allocation perspective, he argued, having everyone keep a chunk of the world's limited DRAM supply sitting idle in their own machines 95% of the time is terrible in a supply-constrained environment — maximum cloud utilization is the rational path. The retweet comes with a goose meme asking "why is the DRAM supply limited?"
More from Infra
- Nvidia weighs cosigning loan for Nscale's West Virginia AI data center — TechCrunch AI · 2026-10-31
- Northflank dunked on Railway's breach, then got hacked the same way 9 days later — aniketmaurya · 2026-10-31
- Dev says Neon is already chasing millisecond infra branching, wants it built into alchemy — samgoodwin89 · 2026-10-31
- Big AI labs all push compute efficiency: Trainium power savings, small models, cache compression — WillfullyWorkable · 2026-10-31
- Running 12 agents on one RTX 3090 lifts total throughput from 30 to 110 tok/s — Mchanger · 2026-10-31
- Analyst turns ultra-bull on Avicena after 6 hours of technical diligence — BenBajarin · 2026-10-31