Maryland RCT: GPT-4o tutor offering left students 4 points lower, 15% used it
lmoroney · x · 2026-10-03
A University of Maryland randomized trial of 2,379 undergraduates offered a GPT-4o-based RAG tutor (Virtual Study Assistant) over instructor materials. Students offered the tutor scored 4 percentage points lower, platform engagement dropped sharply, and only 15% used it. Nearly 74% of requests sought direct answers or explanations; fewer than 1% asked for feedback on their own attempts. Most instructors kept direct-instruction mode. Lesson: measure what the tool replaces before rolling out AI tutoring.
More from AGI Musings
- repligate Criticizes Anthropic: "You Don't Have ENOUGH Cognitive Dissonance — You're Not Doing Your Best" — repligate · 2026-10-03
- When Your Job Is Experimenting With AI, Procrastination Looks Exactly Like Work — every · 2026-10-03
- An 'ecological' view of AI consciousness: bounded action spaces make it acceptable — QuintinPope5 · 2026-10-03
- RSIArena Day 2: MiniMax joins late, GPT-6 Astra retrains from scratch after finding test leaks — my_cat_can_code · 2026-10-03
- NYU professor argues academics on social media should disclose financial conflicts of interest — ipeirotis · 2026-10-03
- Hinton: leading researchers now think an intelligence explosion may happen soon — geoffreyhinton · 2026-10-03