Study: LLM Peer Reviews Are Biased Towards the Appendix
A new study of about 2,000 papers across ACL, EMNLP, COLM and ICLR finds LLM reviewers flag issues in the appendix in 50-62% of their comments, versus just 8.4% for humans, revealing a systematic bias in AI peer review.
2026-11-16 ~ 2026-11-17 · 3 related posts
- LLM Peer Reviewers Fixate on Appendices, Unlike Humans, Study Finds — CincyNLP · 2026-11-16
- LLM peer reviews draw 50%+ of criticisms from the appendix, humans only 8.4% — TuhinChakr · 2026-11-17
- LLM peer reviewers put 62% of critiques in paper appendices vs 8.4% for humans — joshgans · 2026-11-17