Commentary on Christiano/Dwarkesh: training-pipeline automation is desirable and safety-helpful

sebkrier · x · 2026-11-18

Sharing early takes on Dwarkesh's interview with Paul Christiano, the author argues that "RSI" is a misleading initialism better understood as "model training pipeline automation." He sees further automation improving AI capabilities as broadly right, desirable, and even useful for safety. Assuming a slow take-off, much of it is manageable in practice—important risks and fast capability growth are expected, but he's more optimistic about the endogenous societal and technical response. He firmly rejects claims that we may be "six months away from AI systems that can overthrow the government" or that government overthrow is a likely outcome of ML R&D automation.

Original post →

More from AGI Musings

AGI Musings channel →