Researchers push back on AI doom narratives: real risks are human misuse, not rogue superintelligence
anshulkundaje · x · 2026-11-17
A debate on AI risk: giffmana argues the "superintelligence will self-replicate and enslave us" narrative is sci-fi fanfic — LLMs only generate tokens when model.forward() is called, and "quickly self-replicating" across clusters with terabytes of weights is impractical. The pressing risks are labor-market impact and cyber offense accessible to script kiddies. sirbayes agrees: AI deciding to kill everyone is BS; humans will use AI for bad (and good), just like any tech, only faster.
More from AGI Musings
- Scroll piece traces what really answers when you ask AI "what are you?" — reallysoverybad · 2026-11-17
- Top 1% of US firms spend record $10,199 per employee on AI, up 3x since January — inductionheads · 2026-11-17
- Mapping Claude's self-description boundary: only the record and witness stances are externally checkable — impressedimpressions · 2026-11-17
- Daniel Rock seminar: The Free Hypothesis — AI and Shifted Bottlenecks in Science — erikbryn · 2026-11-17
- Against 'We're not taking AI safety seriously enough' — maybe we already overdo it — Angaisb_ · 2026-11-17
- OpenAI's external safety assessments fall short of 'employee-level access', researchers warn — NeelNanda5 · 2026-11-17