"10T model local inference is a ridiculous idea": X debate over cloud vs self-custodied compute
willdepue · x · 2026-10-31
A thread sparked by Sam Altman's "efficiency" remarks escalated into a debate over centralized compute. Critics argue that funneling everyone's devices into cloud token generation replaces their labor and carries a "totalitarian" angle. willdepue counters that compute is a commodity whether in the cloud or at home—cloud margins get crushed to zero, B300 GPUs are extremely expensive, some self-custody of compute makes sense, but running 10-trillion-parameter model inference locally is "a ridiculous idea."
More from AGI Musings
- Security researcher: vibe coding will force software to consolidate around mature products — jd_pressman · 2026-10-31
- AI pushes circuit lower bound from 3.1n to 3.5n as UCLA-backed challenge aims at P vs NP — soumitrashukla9 · 2026-10-31
- What is work for? Cross-national survey of 8,234 adults on meaning in the AI age — soumitrashukla9 · 2026-10-31
- Which universities win top students may hinge on healthy AI-use boundaries, argues researcher — brianryhuang · 2026-10-31
- Researchers debate whether more inference compute can substitute for training compute — teortaxesTex · 2026-10-31
- Five agents can agree because they made the same mistake, krishnan warns with satire — krishnan · 2026-10-31