Karpathy Interview: LLMs Lack Culture and Self-Play, AGI is a Decade Away
i_dg23 · x · 2026-08-01
Dwarkesh Podcast shared an in-depth interview with Andrej Karpathy. Karpathy points out that current LLMs still lack two key elements that propelled human evolution: cultural accumulation (models can't read or be inspired by books written by other LLMs) and self-play (lacking mechanisms like AlphaGo to continuously generate and solve harder problems).
The interview also covers several core topics:
- AGI Timeline: True AGI is still about a decade away.
- Cognition & Learning: Discusses how the smartest models still feel like elementary school students, the limitations of RL, and how humans actually learn.
- Society & Future: Believes AGI will eventually blend seamlessly into 2% GDP growth, and discusses the long evolution of self-driving cars, the future of education, and ASI.
Related event: Karpathy: LLMs Lack Cultural Accumulation and Self-Play(2 posts)→
More from AGI Musings
- First-ever paper on multi-agent swarm safety lands NeurIPS spotlight — LauraRuis · 2026-10-16
- Yoav Artzi on peer review: paper flooding still pays off as review system strains under load — yoavartzi · 2026-10-16
- Letta founder: work in fields defined by problems, not methods — lateinteraction · 2026-10-16
- Why pure mathematicians will soon flood into AI x-risk debates — Dr_Atoosa · 2026-10-16
- RSI began when model outputs augmented next-gen training data, agents just escalated it — akbirthko · 2026-10-16
- Luiza Jarovsky: with AI making careers unpredictable, 'do what you love' is the best advice left — LuizaJarovsky · 2026-10-16