Alignment paper: Finding low-dimensional structure in model behavior

gleech · x · 2026-08-22

David Africa and Geoffrey Irving argue on Resolution that the key to alignment lies in discovering and controlling the low-dimensional structure emerging during pretraining. They cite literature on 'emergent misalignment' and 'subliminal learning' to show that intervening on one behavioral dimension has strong downstream effects on others, suggesting a path for systematic intervention without accidentally hiding undesirable behaviors.

Related event: New Alignment Essay Seeks Low-Dimensional Structure in Model Behavior(2 posts)→

Original post →

More from Safety

Safety channel →