Economist proposes AI-assisted peer review: model reads appendices, expert judges critiques

paulnovosad · x · 2026-11-09

Development economist Paul Novosad outlines what he sees as the current optimal expert paper-review workflow under a fixed time budget: read only the intro, ask a strong AI model for its top 3 critiques, discuss and cross-check against the paper, then judge which critiques are substantive. Responding to "the expert should read the whole paper," he notes nobody was reading the dozens of appendices anyway — having an AI check whether the pre-analysis plan was followed is actually a gain. His core claim: give an expert a powerful new tool and the optimal process must involve tool use, not the old routine.

Related event: Economist Novosad on AI Peer Review: Cheap Laziness, Weak Judgment, and a Hybrid Workflow(7 posts)→

Original post →

More from coding & agent

coding & agent channel →