Harvard RCT: AI Tutors Outperform Elite Active-Learning Classrooms
A Harvard team including Kestin and Miller published a randomized controlled trial in Scientific Reports (June 2025), comparing a custom generative-AI tutor against Harvard's elite active-learning classroom. 194 undergraduates were randomly assigned to study the same physics content, either in small-group, instructor-supported classes or at home with an AI tutor. The AI-tutor group learned more than twice as effectively, scored about 30% higher on final assessments, spent less time, and reported better engagement and motivation. The paper has drawn 210k+ reads and 202 citations to date.
Confirmed
- The study is an RCT published in Scientific Reports by a Harvard team (Kestin, Miller, et al.)
- 194 undergraduates studied the same physics content; the control group was Harvard's interactive active-learning classroom, the treatment group learned purely with an AI tutor
- The AI-tutor group learned roughly twice as much and scored about 30% higher on final assessments in less time
- The AI tutor followed the same evidence-based pedagogical best practices as the classroom; per @EngMoElgaraihy, it used Socratic questioning and step-by-step guidance
- @EngMoElgaraihy also noted the traditional interactive classroom costs about $60,000 per year, highlighting the AI tutor's potential cost advantage
Why it matters
- This is among the first high-quality RCTs to directly compare a generative-AI tutor with a top in-person classroom in a real university setting, providing empirical evidence for AI-driven personalized education
- The results suggest AI tutors may beat elite traditional teaching on both effectiveness and efficiency, with implications for higher-education course design and cost structures
- Authors including @burkov, @humphreyshi, @CurieuxExplorer, and @alvelda all viewed the result as landmark for education
2026-09-28 ~ 2026-09-29 · 6 related posts
Primary sources
- Harvard experiment: AI tutor students scored 30% higher than elite classroom peers — alvelda · 2026-09-28
- Viral Harvard AI tutor experiment claims 2x learning gains at a fraction of tuition cost — EngMoElgaraihy · 2026-09-28
- [source] Harvard RCT: AI Tutor Beats In-Class Active Learning in Less Time — humphrey_shi · 2026-09-28
- [source] Nature RCT: AI Tutor Beats In-Class Active Learning in Less Time — burkov · 2026-09-28
2 near-duplicate retellings: humphrey_shi · CurieuxExplorer