OpenAI CRO says stronger models will align models; safety researchers push back

trevposts · x · 2026-11-18

Safety researcher Nathan Calvin questioned OpenAI CRO Mark Chen's comments on an a16z podcast about recursive self-improvement and alignment. Chen said chain-of-thought monitoring is today's most effective alignment tool and "the future of alignment has to be stronger models aligning other models," with RSI "intricately and deeply in this loop." Calvin notes this sounds close to letting AIs align AIs — which OpenAI has denied is the plan — while CoT monitoring is already deteriorating and will degrade further. The episode also featured John Schulman on what RSI means, why research taste is hard to teach, and why AI may be alignment's best tool.

Original post →

More from AGI Musings

AGI Musings channel →