AI audit flags 147 serious issues in 138 economics papers; scholars urge error-rate baseline
HarrySurden · x · 2026-10-30
An X post reports that Opus 5.5 and GPT-6 Astra independently audited 138 economics papers, flagging 2,035 potential problems—147 serious enough to change headline numbers—with a third agent verifying the findings. Legal scholar Harry Surden replies that the same analysis should be run on a multi-author corpus to establish whether this error rate is typical of economics papers or unusually high.
Related event: AI Audit of 138 Economics Papers Finds 2,035 Issues(12 posts)→
More from AGI Musings
- ML veteran Burkov: superintelligence abundance would drain Earth's remaining resources — burkov · 2026-10-31
- Santa Fe Institute's Eric Smith dismantles anthropocentrism in careful terms — danfaggella · 2026-10-31
- Bindu Reddy predicts 12 months of AI trends: tokens -80%, usage 10x, coding jobs shrink — bindureddy · 2026-10-31
- Accumulating wealth may help build a civilization where wealth itself becomes meaningless — Dr_Singularity · 2026-10-31
- Carl Benedikt Frey asks why some societies are far more suspicious of new technology — carlbfrey · 2026-10-31
- Thoughtworks CTO: Good developers wary of agentic coding because 'built' isn't 'working in production' — rseroter · 2026-10-31