ACL experiments with separate human and AI peer reviews, not human+AI
_akpiper · x · 2026-10-27
An academic revealed that ACL has been experimenting with human and AI peer review — the two review independently, and the viewpoints are then triangulated, rather than letting human reviewers use AI as an assistant.
The core concern: once humans are allowed to use AI in the process, you get the same problem as student writing — nothing stops them from outsourcing the whole review. Since humans and AI have different expertises, the cleaner approach is to add an independent AI review layer on top of human review.
More from Research
- DeepMind: 4 Gemini agents beat Minecraft autonomously in 27 hours, writing 2,783 programs — rohanpaul_ai · 2026-10-27
- Four Gemini agents beat Minecraft autonomously in 27 hours, writing 2,783 programs — rohanpaul_ai · 2026-10-27
- OpenAI PDF claims refutation of ETH, solving 3SAT in exp(n/(log n)^(1/2+o(1))) — rrwilliams · 2026-10-27
- OpenAI Outlines Plan to Build Scientific Understanding with Academia — Chemical-Agency-3997 · 2026-10-27
- Retraction Watch echoes call: pay peer reviewers, don't conscript them — RexDouglass · 2026-10-27
- 2012 whole-cell model paper shows we can scalably measure only ~5 of the processes needed to simulate biology — niloofar_mire · 2026-10-27