Reviewer burnout from AI slop papers: novel work scored 2/2/3/2 as 3 of 4 reviews flagged AI-generated
JessicaHullman · x · 2026-11-07
Researcher nsaphra reports that a paper she considers possibly her most practically impactful work received review scores of 2/2/3/2 — and AI-detection tool Pangram flagged 3 of the 4 reviews as 100% AI-generated.
Her colleague adds a deeper concern: the saddest part isn't the slop reviews themselves, but that human reviewers, fatigued by a flood of vapid AI-generated papers, are increasingly giving negative reviews to genuinely novel work because they lack the energy to engage with new ideas.
The episode highlights a double crisis in peer review: reviews themselves get outsourced to AI, while high-quality innovative work gets penalized by reviewer burnout.
Related event: ICLR Reviewers Caught Submitting Largely AI-Generated Reviews, Authors Say(10 posts)→
More from AGI Musings
- Engineer warns: sacrificing the present entirely for the future is a dangerous game — KevinNaughtonJr · 2026-11-07
- Amazon reportedly trying to rehire employees laid off in AI-driven cuts — DavidLinthicum · 2026-11-07
- Peter Norvig on what's still worth learning when AI takes over the work — Diyi_Yang · 2026-11-07
- RareDiseaseBench debuts: 35 reconstructed rare disease cases test AI diagnostic agents — kenbwork · 2026-11-07
- Signal president debates AI policy head: should we stop trusting AI agents with our data? — neil_chilson · 2026-11-07
- Survey claims 68% of Americans support pausing AI and banning superintelligence — notkilleveryoneist · 2026-11-07