AI peer reviews beat human reviewers in 100% of pairs, 87% by human editors
paulnovosad · x · 2026-10-23
A new paper by Gary King and Steven Worthington, "AI Article Reviews Dominate Human Peer Reviews at Their Best," compares human and AI reviews of the same manuscripts across 134 pairs.
- AI-judged: AI reviews win 100% of pairs; judged by top-journal human editors: 87% overall
- By dimension: Sources, Weaknesses and Methods all 100%, Figures & Tables 99%, everything else ≥92%
- Humans agreed as much or more with AI's judgment than with other humans
The authors argue academic publishing should consider adopting AI review and welcome comments.
More from AGI Musings
- Solving aging solves everything: unlimited time means unlimited solutions, says researcher — rand_longevity · 2026-10-23
- Economist Alex Imas asks what becomes scarce after AI — and why Starbucks reversed automation — soumitrashukla9 · 2026-10-23
- Economist proposes AI-first journals: automated review, one-click replication, formal proofs — Afinetheorem · 2026-10-23
- Economist proposes AI-first journals: AI first-pass review, 1-click replication, formal proofs — Afinetheorem · 2026-10-23
- Blogger pushes back on Jensen Huang: AI will take the new jobs it creates too — VraserX · 2026-10-23
- Abridge physician-engineer on NEJM AI: building is easy now, building safely isn't — AndrewLBeam · 2026-10-23