AI slop submissions strain peer review: experienced reviewers need just 15-20 minutes to spot them
yoavartzi · x · 2026-10-16
A debate on conference peer review in the AI era: one participant argues for mass desk rejects rather than targeting an acceptance rate, noting an experienced reviewer can now tell within 15-20 minutes whether a submission merits review — though that window may shrink as authors get better at disguising low-effort work.
Yoav Artzi pushes back that even 15-20 minutes is optimistic and will soon expire, then poses the structural question: how many experienced reviewer-minutes does it take to handle 60k or 100k submissions, and how many do the community actually have?
More from AGI Musings
- Ex-OpenAI futurist Joshua Achiam warns AI hacks could trigger internet lockdowns within months — jachiam0 · 2026-10-23
- A 1972 feminist essay 'I Want a Wife' doubles as the perfect personal AI product roadmap — mickeyxfriedman · 2026-10-23
- Brynjolfsson, Ajay and Korinek lay out nine grand challenges for economists in the AI era — soumitrashukla9 · 2026-10-23
- Brynjolfsson engages the 'Hayek vs Stanford school' debate on whether institutions can adapt to transformative AI — erikbryn · 2026-10-23
- 3 Quarks Daily's thoughtful AI writing policy: different rules for different content — lmoroney · 2026-10-23
- Dario's predictions on track: Mythos 'security tsunami' warning and 6-12 month China catch-up window — rickasaurus · 2026-10-23