ICML Study: LLM-Assisted Review Dual-Track Policy Shows No Scoring Bias
icmlconf · x · 2026-07-07
ICML released a study on LLM usage policies in paper reviewing, having deployed a dual-track policy allowing and disallowing LLMs. Statistical analysis revealed that the policy choice had no significant impact on final score distributions and acceptance decisions. These findings help alleviate concerns about systematic biases introduced by LLM-assisted academic reviews.
Related event: ICML 2026 Adopts New Policies for LLM Usage in Peer Review(3 posts)→
More from Safety
- Why So Many AI Researchers Think the Machines Could Kill Everyone — wiredmagazine · 2026-09-11
- California creates standards for independent AI auditors to verify lab safety testing — VraserX · 2026-09-11
- a16z podcast: why 2-3 person startups are absent from policy debates — a16z Podcast · 2026-09-11
- Researcher questions AI safety eval firm, citing 'blatantly sloppy' security and monitoring — Kyrannio · 2026-09-11
- Class action accuses Anthropic of overselling Claude subscriptions with deceptive usage multipliers — The Decoder · 2026-09-11
- MD shows buying lab media requires background checks, calling AI bioweapon doom scenarios implausible — Ghost_Pilot_MD · 2026-09-11