Georgetown's AI referee leaderboard has Claude Opus 4.8 scoring finance papers
emollick · x · 2026-09-07
Ethan Mollick highlighted Georgetown's "AI Referee Paper Leaderboard," where Claude Opus 4.8 acts as an AI referee scoring the top 100 finance and economics working papers against a fixed rubric across significance, originality, correctness, data & methodology, and exposition, with full public reports. He frames it as both an experiment and a sign of a coming tsunami for academia: AIs retroactively reading published research and publicly flagging opportunities and flaws.
More from AGI Musings
- Senior researcher rebuts 'one-person pretraining' fear: your fundamentals matter more, not less — RexDouglass · 2026-10-23
- PHP, certificates, railways: a 48-hour wave of hacking incidents unpacked — David Ondrej · 2026-10-23
- NBER releases 'The Economics of Transformative AI' edited by Agrawal and Brynjolfsson — JMateosGarcia · 2026-10-23
- Pedro Domingos: AI Is an Intelligence Lever — the Smarter You Are, the Smarter It Makes You — pmddomingos · 2026-10-23
- Anil Seth: Consciousness Is a Property of Life, Not Computation — Building Conscious AI Is a Bad Idea — anilkseth · 2026-10-23
- Pedro Domingos predicts 2027 will see the most security vulnerabilities fixed in history — pmddomingos · 2026-10-23