If an AI-written referee report is actually good, does it matter?
BarbaraBiasi · x · 2026-10-21
Barbara Biasi's thread on AI in peer review: suppose a referee report is flagged 100% AI-written. Either it's obvious AI slop — in which case the detector wasn't needed — or it reads well and makes good points. She asks: the goal of a report is to make the paper better; is that goal defeated if the report is excellent but has some AI in it?
More from AGI Musings
- Haider: reactions to OpenAI's math proofs show people still underestimate the trajectory — haider1 · 2026-10-22
- "Models don't produce simplicity — they hedge for completeness": the root of AI slop — matt_slotnick · 2026-10-22
- Will privacy become a thing of the past? Insiders warn data will reach bad actors — daniel_mac8 · 2026-10-22
- Dev warns cheap open-source agents are now trivially finding low-hanging security vulns — zack_overflow · 2026-10-22
- 20 episodes in: the guest list mapping China's tech landscape, from robots to open source — pstAsiatech · 2026-10-22
- When everyone lowers their AI slop score, is that a good equilibrium? — JessicaHullman · 2026-10-22