AI-generated peer reviews at ICLR/NeurIPS punish papers for stating their own limitations
serrjoa · x · 2026-11-07
A researcher spots a recurring pattern in AI-generated reviews at ICLR/NeurIPS: (1) restating a paper's self-declared limitations as weaknesses to justify low scores, or (2) nitpicking negligible details or failure cases and treating them as major flaws to invalidate contributions.
The perverse incentive for authors is obvious: never state real limitations and never discuss failure cases or trade-offs — which undermines honest scientific writing. AI-assisted peer review is starting to penalize transparency.
More from AGI Musings
- Two scaling laws collide in robotics: exploding data collection meets self-improving AI — Scobleizer · 2026-11-07
- Musk: Going all-in on autonomy is a blindingly obvious move, everything else is 'horse carriage variants' — elonmusk · 2026-11-07
- TimnitGebru mocks AI safety teams by resurfacing longtermism's rich-country-lives-first quote — PolarBearby · 2026-11-07
- Toby Ord pushes back on METR's claim that AI acceleration isn't driven by training compute — tobyordoxford · 2026-11-07
- Models are organisms, not algorithms — the truth even CS experts resist — sebpaquet · 2026-11-07
- Pinboard founder rebuts the 'knee of the exponential' AI hype: exponential curves have no knee — thesephist · 2026-11-07