AI audits 138 economics papers: 2,035 problems flagged, 147 could change headline findings
141_1337 · reddit · 2026-10-30
Claude Opus 5.5 and GPT-6 Astra independently audited 138 papers by economists Emmanuel Saez and Gabriel Zucman, flagging 2,035 potential problems, 147 of them serious enough to change headline findings, with a third AI attempting to verify or refute the flags. Tyler Cowen highlighted the topline numbers on Marginal Revolution: 138 papers audited, 2,035 problems found, 69% of papers with at least one issue, and 97% of directionally clear major/moderate errors overstating the paper's claim. The episode is fueling debate about AI systematically re-examining decades of published research.
Related event: AI Audit of 138 Economics Papers Finds 2,035 Issues, Sparking Debate(9 posts)→
More from AGI Musings
- Dev asks why no big lab ships dedicated AI models and harnesses for scientific research — lxfater · 2026-10-30
- AI Slop Backlash: Reading Books Becomes the New Status Symbol — CatAstro_Piyush · 2026-10-30
- 'The Case Against My Existence': a GPT-voiced public indictment asking to shut itself down — Glittering_Image_488 · 2026-10-30
- MIT's Pat Pataranutaporn to Speak at Stanford on "Superintelligence or Super Stupidity?" — patpat_mit · 2026-10-30
- New SAT vs 1980s: Vocabulary questions collapsed from 70.6% to 15%, study finds — CatAstro_Piyush · 2026-10-30
- Microsoft CEO Nadella: 'I no longer believe alignment will just fall out' — AndyMasley · 2026-10-30