Alignment Is Far More Than an Engineering Problem, Pushing Back on Jensen Huang
ShahabBakht · x · 2026-10-22
A thread on the loss of control and comprehension from autonomous AI: competitive pressure has always driven the world, but it may now backfire to the point where science itself is no longer controlled—or even understood—by humans.
The author argues that alignment—ensuring autonomous AI follows human values, preferences, and objectives—is arguably the hardest problem in AI today, and progress on it lags far behind the pace of capability gains. Pushing back on Jensen Huang's claim (on Ezra Klein's podcast) that alignment is just an engineering problem and control won't be an issue, the author calls that optimism dangerously premature.
Related event: Commentary: competitive pressure may push science beyond human control(2 posts)→
More from AGI Musings
- Grady Booch Slams Altman and Amodei: AGI Hype Is Irrational and Untrustworthy — Grady_Booch · 2026-10-22
- Crosby trains judge models to evaluate legal AI where no unit tests exist — graceisford · 2026-10-22
- BaseLabs open-sources mammoth-1 and elephant-1, top-ranked decision models — saranormous · 2026-10-22
- AI-generated short dramas wipe out makeup artists, extras and lighting crews — TuhinChakr · 2026-10-22
- Seth, Block and Tononi in Nature: AI isn't conscious and probably won't be — Justgototheeffinmoon · 2026-10-22
- Tyler Cowen: Reading AI Writing Is an Option on Future Connections Worth Near Zero — paulnovosad · 2026-10-22