Study: Opus 4.8 beats human experts at peer review across 124 Harvard social science papers
soumitrashukla9 · x · 2026-10-24
Ethan Mollick highlights a study of 124 Harvard social science papers—spanning statistical analyses, formal models, and qualitative work—finding that by every measure, Opus 4.8 beats human experts as peer reviewers. Mollick and scholars like Matt Beane argue academia must rapidly adapt the practice of science and publishing to AI, noting current change is far too slow.
Related event: Harvard Study Finds Claude Opus Peer Reviews Beat Top Human Experts(16 posts)→
More from AGI Musings
- Critic slams deliberately handicapping AI search as dumb as the clock-speed wall — JosephJacks_ · 2026-10-24
- Ross Taylor: studying LLM behavior will increasingly resemble social science — rosstaylor90 · 2026-10-24
- New Yorker cartoon: "pick a field that will still require humans when you graduate" — docmilanfar · 2026-10-24
- Most "is AI conscious?" debates boil down to two people talking past each other — granawkins · 2026-10-24
- 20VC: Naveen Rao says inference is a $10T market and robotics 100x bigger than coding agents — 20VC · 2026-10-24
- Hot take: Gen Z may lose more to AI than Gen Alpha, argues Reddit post — SoftAndWetBubbles_78 · 2026-10-24