Yudkowsky predicted compute-scaling AGI risk all the way back in May 2003

RichardMCNgo · x · 2026-11-23

Rob Bensinger resurfaced an Eliezer Yudkowsky essay from May 2003 showing he already held both views long before the scaling era: that scaling compute would eventually reach AGI, and that compute gains would let us build AI without deep understanding — a huge risk.

The excerpt argues Moore's Law lowers the bar for building AI but does nothing for alignment, which is a problem of understanding, not hardware. Once compute suffices for anyone who 'knows exactly what they're doing' to build AI, 'Moore's Law is the countdown and it is ticking away. Moore's Law is the enemy.'

Original post →

More from AGI Musings

AGI Musings channel →