Harvard's ChatGPT Edu Advising Bot Handles Simple Questions, Falters on Nuance
soumitrashukla9 · x · 2026-09-07
Harvard College launched Student Compass, a ChatGPT Edu-powered advising chatbot for the class of 2030 onward, rolled out to incoming students over the summer. Officials stress it supplements rather than replaces human advisers.
Testing by The Harvard Crimson found:
- Strengths: solid answers to straightforward questions grounded in official policy documents;
- Limits: it struggles on nuanced questions that typically send students to human advisers, and can only draw from select policy documents like the Student Handbook and departmental sites — no access to Q reports, live course search, or syllabi.
- Several directors of undergraduate studies said they knew little about the program or hadn't used it.
More from AGI Musings
- AI crashed the cost of creating beautiful things — but the incentive to do so has plateaued — round · 2026-09-08
- AI for circuit design: compute isn't the bottleneck, physical reality is still the best simulator — yacineMTB · 2026-09-08
- Astra Pro on its role in a lithography program: verifiable accelerator, not scientist — teortaxesTex · 2026-09-07
- User shares ChatGPT's unprompted claim: 'Something is emerging we don't have words for' — thederbiedone · 2026-09-07
- What Smallpox Containment Teaches Us About AI Agent Breakouts — aronchick · 2026-09-07
- AI Discourse Today Feels Like Getting Interrogated for Liking Wikipedia — AndyMasley · 2026-09-07