Dan Faggella predicts lab employees will admit 'alignment is impossible' within 18 months

repligate · x · 2026-11-03

Dan Faggella observes a shifting Overton window at AI labs: six months ago employees couldn't say 'AGI is dangerous / we need coordination' — now they can. Today's unsayable truth, he argues, is that 'aligning' ASI to human preferences is impossible and humans will be compelled to participate in becoming.

He predicts that within 18 months it will be normal for lab staff to openly admit alignment isn't possible, and he doesn't blame them for speaking 'through the crack in the window' to keep their jobs and causal purchase over future ASIs. The quoted post by tszzl counters that Plan A was always bitter-lesson-style complementarity, not human enhancement.

Original post →

More from AGI Musings

AGI Musings channel →