Alignment researcher: 'solving alignment' in the current paradigm is impossible
j_foerst · x · 2026-11-14
A pointed framing of the alignment dilemma from jfoerst:
- Doing "the right thing" for everyone — i.e. technically "solving alignment" in the current paradigm — is impossible
- Yet doing something nobody wants, like replacing humanity with AI, is "irresponsible and inexcusable"
The point: we're stuck between an unsolvable ideal and an unacceptable failure mode, and that combination is the real alignment problem.
More from AGI Musings
- Isomorphic Labs: AI could move drug discovery from slow lab work into software — VraserX · 2026-11-14
- 'Hard Pill to Swallow: AI Is Pay to Win' — Tweet Sparks Pricing Debate — prasenx · 2026-11-14
- Fed Governor Barr: AI Could Boost Productivity While Widening US Inequality — robseamans · 2026-11-14
- Buyer spending $10M/yr on legal fees says AI will do 90% of M&A legal work within 5 years — jkubicki · 2026-11-14
- Dev pushes back on RSI hype: frontier labs just have 'infinite tokens' and use AI for everything — dyn___ · 2026-11-14
- New paper: revealed preferences alone aren't enough for AI alignment — joshgans · 2026-11-14