NeurIPS Peer Review Debate: Should Reviewers Reveal Score Flexibility?
miniapeur · x · 2026-08-05
An AI researcher proposed improvements for this year's NeurIPS peer review process. Beyond meta-reviews, the author argues that reviewers should explicitly state upfront whether they are open to raising or lowering their scores during the rebuttal phase.
The practical pain point is that authors often cannot realistically address reviewers' concerns within a one-week rebuttal window. If reviewers clarify early on that their scores are fixed, it helps authors set realistic expectations and allows area chairs to factor this in if a reviewer becomes unresponsive.
Related event: NeurIPS 2024 Review System Sparks Debate Over Compute and Calibration(3 posts)→
More from Research
- Local LLMs Fail at Route Planning: How to Implement Geospatial RAG? — breksyt · 2026-08-05
- Study: Weaker LLMs Rewriting Prompts for Stronger Models Boosts Zero-Shot Performance — max_paperclips · 2026-08-05
- Medical AI Benchmarks Are Soaring, But Real-World Clinical Impact Remains Minimal — EhudReiter · 2026-08-05
- Peking University Introduces ContinualSkillBench: Evaluating Continual Skill Evolution in LLM Agents — PekingUniversity · 2026-08-05
- AI Singapore Compresses LLM Training to 2 Days, Adds Five Low-Resource SEA Languages — davlanade · 2026-08-05
- NeurIPS Peer Review in Decline: ChatGPT Responses and Hallucinated Citations Plague Submissions — Pseudomanifold · 2026-08-05