RCT: AI as tutor raises test scores that persist; letting AI write for you fades within a week
emollick · x · 2026-10-10
Ethan Mollick shared randomized trial results using older GPT-4o: AI access raises test scores, with a smaller gain persisting a week later. Crucially, gains persist for students who use AI as a tutor ("augmentation") but fade for students who have AI write for them ("automation"). All experiments across the study showed positive effects, providing RCT-level evidence that how students use AI matters more than access itself.
Related event: RCT: AI Tutoring Boosts Learning, Copy-Paste Doesn't Stick(2 posts)→
More from AGI Musings
- Harvard Medical School and Google DeepMind team up on conversational AI diagnostic study — alan_karthi · 2026-10-10
- Michael Nielsen: Vinge's 1993 "opaque wall across the future" is now being felt by more people — eigenhector · 2026-10-10
- Mathematicians slam AI labs for using experts as free RL fact-checkers — soumitrashukla9 · 2026-10-10
- OpenAI Researcher: Econ Theorists Have the Best Intuitions for Managing Agent Swarms — willcb · 2026-10-10
- Terence Tao: The Era of "Big M" Mathematics and "Big P" Physics Has Arrived — CatAstro_Piyush · 2026-10-10
- Sakana AI Researcher on Why Artificial Life Ideas Matter More as Autonomous AIs Proliferate — kenneth0stanley · 2026-10-10