LLM reviewers draw 50% of weaknesses from the appendix vs 8% for humans
plopesresearch · x · 2026-11-18
Shared research data shows LLM reviewers source 50% of their listed weaknesses from a paper's appendix, compared to just 8% for human reviewers. The accompanying chart also reveals markedly different attention distributions across main-body pages. The general trend: human reviewers focus on the big picture, overall presentation, and support for major claims, while AI reviewers nitpick details — a key consideration for AI-assisted peer review.
Related event: Study: LLM Reviewers Fixate on Appendices Far More Than Humans(4 posts)→
More from Models
- Developer: DeepSeek 4.1 Flash is basically free to run for personal use — rickasaurus · 2026-11-18
- Users ditching Fable 5.2 for Opus 5.5 as rate limits burn too fast — scaling01 · 2026-11-18
- Sol6.2 does PCB layout for ~$4 in 40 min, rivaling fable5.2 at 1/15 the cost — yacineMTB · 2026-11-18
- Qwen4-Max goes live on Runware with 1M-token context at $1.50 per 1M input tokens — Alibaba_Qwen · 2026-11-18
- GPT-6.2 tested on long-horizon finance: Sol regresses 2.4 points, Astra hits #2 — gabrielchua · 2026-11-18
- Qwen4-Max reportedly out; blogger tests it as an AI teammate on 3D and game dev — aftahi_ai · 2026-11-18