Deep-dive: no current AI can independently cause extinction, but loss-of-control risk demands governance now
galgo13 · reddit · 2026-09-24
A 17-section investigation by darksignals.org surveys the existential-risk debate. Key judgments: no public evidence shows any current AI system has the autonomy, reliability, access, and physical-world agency to independently cause extinction; near-term misuse risks (cyber, some bio/chem assistance) are far better evidenced; a cited 2026 OpenAI/Hugging Face incident reflects a serious containment failure, not hostile intent. Time horizons: agentic autonomy could raise misuse risk within 1–3 years; loss-of-control could become material in 3–10 years if capabilities converge. Conclusion: catastrophic risk is serious enough to monitor and govern now.
More from AGI Musings
- Ross Girshick posts CVPR slides recounting 1.5 decades of object detection and its link to the LLM era — CatAstro_Piyush · 2026-11-11
- Ben Todd wrestles with a 50:50 chance only 18 months remain of 'the human era' — ben_j_todd · 2026-11-11
- Mathematicians face identity crisis as AI solves problems in hours, Corriere interview warns — ValerioCapraro · 2026-11-11
- Why inference speed will be AI products' biggest competitive edge in 1–2 years — itsOmSarraf_ · 2026-11-11
- AI Defense Shifts to Scale Economics: Attacks Buried in Legitimate Traffic — DavidLinthicum · 2026-11-11
- Ben Todd's alt log-log plot shows task horizons hitting a singularity in under 12 months — ben_j_todd · 2026-11-11