Geoffrey Irving: 'Slop proofs' may stump even AI, a risk for RSI-era alignment delegation

ronbodkin · x · 2026-11-20

DeepMind alignment researcher Geoffrey Irving warns that a mountain of 'slop proof' that technically checks out isn't just incomprehensible to humans — AIs may also struggle to build on it until the proof is simplified. He maps this onto AI companies trying to delegate alignment work to not-yet-superintelligent machines during recursive self-improvement: uninterpretable outputs could bottleneck further progress. Ron Bodkin adds that this is why human understanding remains critical as AI agents automate research, especially for safety.

Original post →

More from AGI Musings

AGI Musings channel →