AI Conference Peer Review is Broken: Unresponsive Reviewers and Misguided Feedback
RexDouglass · x · 2026-08-03
The peer-review mechanism in AI academic conferences is facing a severe crisis. Researchers report extremely low reviewer engagement for NeurIPS 2026, with response rates dropping below 5% even after multiple reminders. Furthermore, at EMNLP's ARR, meta-reviewers are making factual errors and demanding inappropriate ablation studies, completely ignoring the nature of pure dataset and benchmark papers.
This lack of engagement and superficial evaluation has led to deep frustration within the community, with some calling the entire review process "completely broken" and questioning the value of the months-long pipeline.
More from AGI Musings
- Pangram Detector Flags Hank's Script as AI-Generated, Sparking Debate — AndyMasley · 2026-08-03
- AI Decouples Productivity from Skill Learning in Software Engineering — alexisgallagher · 2026-08-03
- Calls by OpenAI and Anthropic to Slow AI Risk Antitrust Violations — AccBalanced · 2026-08-03
- After AlphaFold Shattered PhDs, AI's Next Target is Mathematics — roydanroy · 2026-08-03
- 'Choice Paralysis' Will Skew AI Productivity Numbers — dreamwieber · 2026-08-03
- Gary Marcus Fires Back at LLM Fanboys: 'Gaslighting' and 'Intellectually Dishonest' — GaryMarcus · 2026-08-03