Reviewer finds AI-written peer reviews rampant at ARR, calls for benchmarks of AI reviews
ChenhaoTan · x · 2026-09-09
- ChenhaoTan finished his ARR reviewing duties and noted that one submission appears to have received three human reviews — implying many reviews are now AI-written.
- He argues that given how prevalent AI reviews are, the community needs good benchmarks to evaluate AI review quality.
- Highlights how AI is penetrating peer review on both sides: writing papers and writing the reviews.
More from AGI Musings
- Abacus.AI CEO Bindu Reddy mocks AI doom rhetoric: "10% chance we kill everyone" — bindureddy · 2026-09-09
- AI copyright debate slammed for double standards: artists vs. stolen math proofs — mgill25 · 2026-09-09
- Fei-Fei Li: R&D is forking into token-abundant and token-starved paths — zhaoran_wang · 2026-09-09
- Richard Socher's new book argues recursive self-improvement will usher in prosperity — RichardSocher · 2026-09-09
- Debating Taylor Lorenz: underreaction to extinction risk is scarier than overregulation — austinc3301 · 2026-09-09
- Martin Ford discusses AI's economic impact and new edition of "Rise of the Robots" on GAEA Talks — MFordFuture · 2026-09-09