Large-Scale Study: AI Reviewers Often Ignore How Much You Improved Your Paper
umd-zhou-lab · hf · 2026-11-04
A large-scale study from UMD's Zhou Lab analyzing paper revision trajectories finds that AI reviewers frequently fail to reflect manuscript improvements in their scores, and user opinions often override the observed revision gains — meaning substantial revisions may go unrewarded in AI-assisted review.
More from Research
- New task formalizes semantic anomaly detection: spotting commonsense errors in AI-generated images — burkov · 2026-11-04
- Berkeley's Value Forcing: enforcing Bellman consistency at every noise level for accurate RL value functions — berkeley_ai · 2026-11-04
- Living review protocol registered on OSF, MIT-licensed code, PRs welcome — maier_ak · 2026-11-04
- 3 open-weight LLMs auto-screen 15,034 records: sensitivity 1.00, specificity 0.98 — maier_ak · 2026-11-04
- Guess the Optimizer: can you identify all four from their loss-surface trajectories? — cneuralnetwork · 2026-11-04
- Claude analysis of Gino case file flags 34-40 unretracted papers where no co-author saw the data — RobbWiller · 2026-11-04