Harvard's ChatGPT Edu Advising Bot Handles Simple Questions, Falters on Nuance
soumitrashukla9 · x · 2026-09-07
Harvard College launched Student Compass, a ChatGPT Edu-powered advising chatbot for the class of 2030 onward, rolled out to incoming students over the summer. Officials stress it supplements rather than replaces human advisers.
Testing by The Harvard Crimson found:
- Strengths: solid answers to straightforward questions grounded in official policy documents;
- Limits: it struggles on nuanced questions that typically send students to human advisers, and can only draw from select policy documents like the Student Handbook and departmental sites — no access to Q reports, live course search, or syllabi.
- Several directors of undergraduate studies said they knew little about the program or hadn't used it.
More from AGI Musings
- Lab monkeys at $30-80K each: a 4-year breeding cycle is the real preclinical drug bottleneck — zebird0 · 2026-10-27
- CJR: journalists should stop hyping AI's supposed humanity — just say 'rogue' — ShakeelHashim · 2026-10-27
- PhD applicant emails up 4x YoY due to AI — writing without AI now makes you stand out — AI4Code · 2026-10-27
- Weil's collapse shows BigLaw dies from eroding belief, not a broken business model — jkubicki · 2026-10-27
- All 8 Transformer paper authors left Google, and rival labs captured most of the frontier value — signulll · 2026-10-27
- Anthropic's S-1 pledges AI for curing diseases and serving 4.6B underserved patients — petergyang · 2026-10-27