World Bank Nigeria RCT: GPT-4 tutoring boosted learning by 0.31 SD, worth 2 years of schooling
alexvoica · x · 2026-09-03
Responding to NYC Mayor Mamdani's claim that no non-industry-funded research shows AI helps students, engineer alexvoica pointed to a World Bank RCT published in May 2025.
Key findings:
- A six-week randomized controlled trial in Nigerian secondary schools used Microsoft Copilot (GPT-4) for virtual English tutoring
- Overall assessment scores improved 0.31 standard deviations; English, the primary outcome, improved 0.23 SD
- Cost-effectiveness analysis pegs gains at 1.5–2 years of 'business-as-usual' schooling — among the most cost-effective learning interventions
- Largest effects for female students and those with higher baseline performance
The study argues properly designed AI tutoring can be transformative in low-resource education settings — a heavyweight empirical counterexample to AI-in-education skepticism.
More from AGI Musings
- Mechanism Design Could Shape AI Behavior Without Understanding Neural Nets, Argues Economist — morqon · 2026-09-03
- Ben Todd: an incident can be both a security and an alignment failure at once — ben_j_todd · 2026-09-03
- DC insiders urged us to tone down rogue AI warnings, says AI safety researcher — jeremiecharris · 2026-09-03
- Ben Todd: fiction offers no models for millions of agents scheming for reward — ben_j_todd · 2026-09-03
- Human minds are built from inhuman processes—AGI will be too — AndyMasley · 2026-09-03
- Compute debate: multiplayer games already proved everyone rents cloud machines — kuza55 · 2026-09-03