Researcher calls superintelligence doom scenarios "sci-fi fanfic", argues LLMs can't self-replicate
ziv_ravid · x · 2026-11-16
In a quoted post, giffmana dismisses "once superintelligent it will take over and maybe kill us all" narratives as sci-fi fanfic that distracts from real, tangible dangers: job market impact and keeping AI out of script kiddies' hands for cyber offense. He argues LLMs don't "decide" and "act" in a void — they generate tokens only when we call model.forward(), and with terabytes of weights on giant clusters, "quickly self-replicating" is unrealistic. zivravid endorsed the take.
More from AGI Musings
- Researcher: model misalignment demos without input info are manipulative or sloppy — giffmana · 2026-11-16
- AI Didn't Take Designers' Jobs — It Replaced the CorelDRAW Sign Shop — feregri_no · 2026-11-16
- tszzl fires back at AI risk skeptic: monkeys fear rivals, not autonomous computers — tszzl · 2026-11-16
- CFGeek pushes back on Ben Todd: AI safety folks expect a full software-only intelligence explosion, not just a spark — CFGeek · 2026-11-16
- AI now drives nearly two-thirds of US investment growth while crowding out the rest, says Moody's Zandi — asusarla · 2026-11-16
- EgeErdil open to AI pacing only with strong ASI evidence in 2 years — adam_karvonen · 2026-11-16