Sam Altman calls local inference 'terrible allocation' of scarce resources; critics push back on ownership grounds
TheZachMueller · x · 2026-10-30
Sam Altman argued that local inference is a terrible allocation of scarce resources: open-source models make people assume they can run everything on their own computers, but having the world's limited DRAM sit idle in personal machines 95% of the time is wasteful — in a supply-constrained environment you want maximum utilization in the cloud.
The pushback was swift: "Your car sits parked most of the day. That doesn't mean a taxi company should own it." @Davidstout argued that ownership buys autonomy, availability, and control, and that calling that 'inefficient' is convenient framing for businesses that sell access.
The exchange crystallizes a core infra debate: centralized cloud efficiency vs. the sovereignty and privacy of local deployment.
Related event: Altman calls local inference a poor use of scarce DRAM, sparking backlash(13 posts)→
More from AGI Musings
- Are money maximizers safer than paperclip maximizers? A post deemed to settle the debate — eigenhector · 2026-10-30
- Rob LeClerc: We're in the biggest bubble ever, yet stocks crash on unmet demand — robleclerc · 2026-10-30
- Dev: my AI interaction flipped from 95% typing to 95% speaking in 3 weeks — granawkins · 2026-10-30
- Allie Miller: Why Is AI Still So Painfully Single-Player? Multiplayer AI Is Missing — alliekmiller · 2026-10-30
- Stanford prof: think first, then use AI—delegating thinking early erodes your mind — anshulkundaje · 2026-10-30
- Nadella no longer believes alignment "falls out" by default, calls it a harder problem — connoraxiotes · 2026-10-30