61% of 18 reviewed manuscripts had undisclosed deviations, technical errors, or heavy AI writing
paulnovosad · x · 2026-10-07
Scholar Brendan Nyhan audited his last 18 first-round manuscript reviews: all 6 preregistered studies had undisclosed deviations, 9/18 had notable technical errors, and the last two were substantially AI-written — 11/18 (61%) had at least one issue. He urges journals to fix screening pipelines, noting they already struggle with low-quality submissions and reviewer shortages, and offers to help editors build a fix. Economist Paul Novosad amplified the call.
More from AGI Musings
- Roman Yampolskiy: the miracle isn't that AI does math, it's that humans ever could — romanyam · 2026-10-07
- Nat Eliason floats an "Alpha art school": academics in the morning, creativity after lunch — nateliason · 2026-10-07
- Neil Chilson to doomers: which factual developments would falsify your beliefs? — neil_chilson · 2026-10-07
- Token efficiency is your security posture: why open models and routing matter for AI defense — sudoraohacker · 2026-10-07
- Naked Scientists launches Why AI series featuring Hinton, Wooldridge and Wendy Hall — wooldridgemike · 2026-10-07
- Countering the 'slow math takeoff' claim: without preregistration the AI progress curve misleads — Jsevillamol · 2026-10-07