AI Conference Peer Review is Broken: Unresponsive Reviewers and Misguided Feedback
RexDouglass · x · 2026-08-03
The peer-review mechanism in AI academic conferences is facing a severe crisis. Researchers report extremely low reviewer engagement for NeurIPS 2026, with response rates dropping below 5% even after multiple reminders. Furthermore, at EMNLP's ARR, meta-reviewers are making factual errors and demanding inappropriate ablation studies, completely ignoring the nature of pure dataset and benchmark papers.
This lack of engagement and superficial evaluation has led to deep frustration within the community, with some calling the entire review process "completely broken" and questioning the value of the months-long pipeline.
More from AGI Musings
- First-ever paper on multi-agent swarm safety lands NeurIPS spotlight — LauraRuis · 2026-10-16
- Yoav Artzi on peer review: paper flooding still pays off as review system strains under load — yoavartzi · 2026-10-16
- Letta founder: work in fields defined by problems, not methods — lateinteraction · 2026-10-16
- Why pure mathematicians will soon flood into AI x-risk debates — Dr_Atoosa · 2026-10-16
- RSI began when model outputs augmented next-gen training data, agents just escalated it — akbirthko · 2026-10-16
- Luiza Jarovsky: with AI making careers unpredictable, 'do what you love' is the best advice left — LuizaJarovsky · 2026-10-16