Dan Robinson: AI is extremely dangerous even if fully aligned, so Manhattan-project safety plans misfocus
michael_nielsen · x · 2026-11-19
Dan Robinson adds a take while amplifying Michael Nielsen's ASI risk essay: because alignment is a difficult and tempting research problem, too many "Manhattan project for safe AI" concepts focus on it. But ASI remains extremely dangerous and disruptive even if it is fully aligned — echoing Nielsen's argument that the fundamental risk lies in the raw power such systems confer, not merely in control failure.
More from AGI Musings
- If AI execs truly believed the risk, they'd be coordinating a stop — they aren't — wfithian · 2026-11-19
- AI Safety Community Emotionally Processing x-Risk: 'My Biggest Regret Is Not Doing This Earlier' — trevposts · 2026-11-19
- "Obsolete ideas have tenure": why AI experts anchor on outdated views — repligate · 2026-11-19
- Stanford researcher: most scientific output doesn't really need peer review — anshulkundaje · 2026-11-19
- Stanford prof Anshul Kundaje: most scientific output doesn't really need peer review — anshulkundaje · 2026-11-19
- Michael Nielsen: the real ASI danger is raw power, not a rogue misaligned system — michael_nielsen · 2026-11-19