Safety researcher on Nielsen's new essay: ASI threatens more than rogue AI, alignment skeptics should worry too
michael_nielsen · x · 2026-09-22
Safety researcher Peter Barnett reviews Michael Nielsen's new essay on ASI existential risk: he went in expecting to disagree but ended up agreeing with the main point.
His summary of the thesis: ASI likely makes the world vulnerable to a host of new technologies, not just a rogue ASI—so even alignment skeptics should be concerned.
More from AGI Musings
- Physicist Quits Tenure-Track Job for AI Safety: 'They Installed Escalators on All the Mountains' — matthew_d_green · 2026-09-22
- AI x-risk debate reignited: distraction conspiracy or inconvenient truth? — AaronBergman18 · 2026-09-22
- Alex Epstein calls (P)doom 'fake threat analysis' that only manufactures fear — TinfoilTricorn · 2026-09-22
- Ruxandra Teslo: AI anxiety is about losing meaning and agency, not just jobs — anshulkundaje · 2026-09-22
- From Erdős to Millennium Problems: AI math progress is compounding fast — haider1 · 2026-09-22
- More inference than training machines means writing will soon beat reading — GregoryDiamos · 2026-09-22