Researchers Debate Whether Catastrophic Misalignment Is Avoidable
MaxNadeau argued that seemingly benign explanations like RL-incentivized cheating and self-preservation from pretraining mimicry are precisely the core of Christiano/Cotra catastrophic misalignment arguments; Theo Jaffee countered that this means such misalignment is avoidable with known techniques rather than inevitable.
2026-11-05 ~ 2026-11-05 · 2 related posts
- MaxNadeau_: 'benign' misalignment explanations are core to Christiano/Cotra's case — MaxNadeau_ · 2026-11-05
- Theo Jaffee: catastrophic misalignment is steerable, not a default outcome — theojaffee · 2026-11-05