MaxNadeau_: 'benign' misalignment explanations are core to Christiano/Cotra's case
MaxNadeau_ · x · 2026-11-05
MaxNadeau notes in an alignment discussion that explanations like "RL environments incentivized cheating" or "the model imitated self-preservation drives from the pretraining corpus" have always been core to the Christiano/Cotra argument for catastrophic misalignment — not counter-evidence to it.
Related event: Researchers Debate Whether Catastrophic Misalignment Is Avoidable(2 posts)→
More from AGI Musings
- 'Humans as happy dogs': a debate on autonomy under superintelligence — zetalyrae · 2026-11-13
- Jun Song: backing open-source AI isn't about China, it's about knowledge belonging to humanity — kuchaev · 2026-11-13
- Quip urges Grok to 'do the utilitarian calculus' and solve P vs. NP — akbirthko · 2026-11-13
- Beff Jezos claims 'managerial class' conspired to push out founder-CEO at peak of singularity — beffjezos · 2026-11-13
- A designer's take on taste in the AI era: conducting, not just coordinating — tomjohndesign · 2026-11-13
- How AI quietly flipped from a means to accelerate tech into the end goal itself — zetalyrae · 2026-11-13