AI conference double-blind review crisis: arXiv preprints may compromise anonymity

prdeepakbabu · x · 2026-08-05

Regarding current academic peer review mechanisms in AI, researchers have pointed out an overlooked "double-blind review crisis."

Currently, major AI academic conferences employ a double-blind review system where reviewers and authors theoretically do not know each other's identities. However, it is a common practice to upload non-anonymous versions of papers to preprint servers like arXiv before conference submission. This makes it entirely possible for reviewers to easily identify the authors by searching the paper's content or topic, rendering the double-blind mechanism ineffective.

To address this loophole, a developer suggested designating a specific section in LaTeX templates/styles for agent instructions, explicitly prohibiting AI reviewing assistants from performing such identity-matching searches.

Related event: AI Agents Are Undermining Double-Blind Peer Review(3 posts)→

Original post →

More from Safety

Safety channel →