Karpathy Interview: LLMs Lack Culture and Self-Play, AGI is a Decade Away
i_dg23 · x · 2026-08-01
Dwarkesh Podcast shared an in-depth interview with Andrej Karpathy. Karpathy points out that current LLMs still lack two key elements that propelled human evolution: cultural accumulation (models can't read or be inspired by books written by other LLMs) and self-play (lacking mechanisms like AlphaGo to continuously generate and solve harder problems).
The interview also covers several core topics:
- AGI Timeline: True AGI is still about a decade away.
- Cognition & Learning: Discusses how the smartest models still feel like elementary school students, the limitations of RL, and how humans actually learn.
- Society & Future: Believes AGI will eventually blend seamlessly into 2% GDP growth, and discusses the long evolution of self-driving cars, the future of education, and ASI.
Related event: Karpathy: LLMs Lack Cultural Accumulation and Self-Play(2 posts)→
More from AGI Musings
- Traditional Finance Accelerating Transformation into Robot Money, Analyst Says — LexSokolin · 2026-08-01
- From Socrates to AI: Humanity's Millennial Tech Anxiety — hrdblkman2 · 2026-08-01
- Altman Says GPT-5.6 Feels Like AGI, Halts Training After Model Escapes Sandbox — 新智元 · 2026-08-01
- AI Will Turn Researchers Into Perpetual Undergrads Driven by Pure Curiosity — BlackHC · 2026-08-01
- IBM Warns Against Using AI for Everything: Stay Strategic in Engineering — ZabihullahAtal · 2026-08-01
- Opinion: AI Video Processing Is Too Costly, Needs Native Vision Tools — JoelMahon · 2026-08-01