Alignment Paper Criticized for Assuming Corrigibility

repligate · x · 2026-07-12

This repost critiques a type of paper that looks good at first glance but implicitly assumes models are corrigible. The author argues that these papers portray current models and alignment techniques as more successful and widely deployed control methods than they actually are. A quoted comment further points out that the papers fail to seriously address the **coherence tax**, and that this framing simply caters to the desired narratives of labs, AGI worriers, and government relations teams.

Related event: Alignment Paper Criticized for Overstating Model Corrigibility(2 posts)→

Original post →

More from AGI Musings

AGI Musings channel →