AGI Risks Extend Beyond Rogue AI
AndrewCritchPhD · x · 2026-07-10
Discussing AGI risk narratives, this response emphasizes that "x-risk" comes not only from out-of-control AI itself, but also from AI-amplified corporations, governments, and even decentralized social trends.
The core argument is that people's reactions to AGI claims often aren't about whether they are overly hyped, but rather which path to loss of control they fear most:
- Out-of-control AI: the typical rogue AI scenario
- AI-amplified corporations/governments: organizational risks with magnified power
- AI-amplified individuals or social trends: more diffuse sources of loss of control
The author frames these within the x-risk discussion of "permanently crippling human potential," noting that "omnicide" could correspond to various loss-of-control mechanisms across different organizational levels.
Related event: Rethinking AGI Risks: Beyond Rogue AI to Societal Amplification(2 posts)→
More from AGI Musings
- AI is still not at a maturity plateau, the author argues — generativist · 2026-07-22
- Essay argues LLMs are externalized metacognition, not standalone intelligence — lnsip9reg · 2026-07-22
- A multipolar AI race will not automatically make AI go well, repost argues — JeffLadish · 2026-07-22
- Decentralized AI as the Antidote to Digital Feudalism in the Economic Singularity — srimisra · 2026-07-22
- Humanoid robot sorting packages in a warehouse sparks debate over job loss — MonaJalal_ · 2026-07-22
- You can outsource thinking, but not understanding, in the age of agents — Yuchenj_UW · 2026-07-22