ML PhD: AI won't destroy the world soon — compute cost is the physical limit
Fit-Gas-5760 · reddit · 2026-09-25
A data-science PhD with 10 years of ML experience argues LLMs are mimics without intent: early 'evil assistant' turns stem from triggered story patterns, not goals. He cites DeepSeek's 2025 paper (arXiv:2503.05132) on surprise-driven reasoning as a strong training pattern. The Transformer paradigm is fundamentally unchanged since 2017, and the real constraint is hardware — he estimates Anthropic's Opus has 5 trillion weights, with compute needs growing faster than inference gains. Conclusion: near-term AI doom is blocked by physics and economics, not alignment.
More from AGI Musings
- AI shatters dev egos, but nerds will just go deeper down the stack — bendee983 · 2026-09-25
- Why AI writing won't beat humans: writing is anti-inductive and shared models wear out — herbiebradley · 2026-09-25
- New show Airlock asks non-tech people what they think of Dario Amodei — jdjohnson · 2026-09-25
- The PM role is now 3 jobs: AI dissolves barriers between customer, engineering, and business — aakashgupta · 2026-09-25
- Updated AGI timeline: just months of agent frenzy before the endgame — danfaggella · 2026-09-25
- Adam Dorr: AI will make medical breakthroughs monthly and bypass FDA gatekeeping — adam_dorr · 2026-09-25