Intelligence isn't destruction: why the AI doom scenario hinges on access, not IQ
Gigo__ · reddit · 2026-09-18
A long Reddit essay argues there's a huge gap between 'AI is extremely intelligent' and 'AI can destroy humanity' — capability depends on access to tools, permissions, and physical systems. Key points:
- Skynet scenario: an autonomous drone army needs manufacturing, power, logistics — the real question is whether humans hand AI enough access to existing infrastructure to repurpose it.
- Financial systems: full simultaneous control of fragmented global finance is extremely hard, but cascade effects between automated systems could trigger a serious crisis — still far from extinction.
- Critical infrastructure: the sharpest risk emerges if humans remove themselves from the loop because AI runs grids and utilities better. Any single failure is recoverable; a truly global catastrophe requires far more.
Conclusion: the serious question isn't how smart AI gets, but how much real-world access we grant it.
More from AGI Musings
- AI community clashes over 'rogue agents' narrative: Redwood and METR quotes fuel the debate — Dan_Jeffries1 · 2026-09-19
- Fields Medalist Villani 'shaken' by OpenAI's claimed millennium problem solution — akbirthko · 2026-09-19
- Most Jobs Don't Involve Einstein-Level Science — and Breakthroughs May Not Boost Growth — binarybits · 2026-09-19
- Thom Wolf: big labs are air-gapped, but researcher departures still leak information — Thom_Wolf · 2026-09-19
- Timothy B. Lee: his wait-and-see AI policy argument fails under 'fast takeoff' — binarybits · 2026-09-19
- 'Doomers are not serious people': the GPT-6 release reignites AI risk debate — inductionheads · 2026-09-19