ICML position track rebuttals largely AI-written, argues for track-wide score calibration
sethlazar · x · 2026-09-25
- Researcher Seth Lazar (quoting Margaret Mitchell on rebuttals easily taking 30 hours) says a "huge proportion" of rebuttals in the position paper track were 100% AI-generated.
- He argues reviewers of a given paper are poorly calibrated: borderline scores act as an attractor for hedging reviewers, so papers cluster at that level and borderline accepts should be calibrated against the whole track — likely meaning many rejections.
- Even for non-borderline papers, he says it's sometimes necessary to overrule credulous reviewers, including those who violated policy by using AI for their reports.
Related event: Researchers Find Many Rebuttals Now Written by AI(3 posts)→
More from AGI Musings
- Roundtable asks: will Igbo, with 30M+ speakers, have a place in the AI future? — ChinasaTOkolo · 2026-11-16
- Malthus Saw It in 1798: Wealthy Avoiding Kids, Delayed Marriage Repeats Today — SydSteyerhart · 2026-11-16
- Runway CEO Predicts Fully AI-Generated Cultural Phenomenon by 2027 — c_valenzuelab · 2026-11-16
- Reddit debates the AI scaling curve: everyone says sigmoid, but where's the ceiling? — Successful-War-9050 · 2026-11-16
- '5% worse and 10% cheaper': the button with no vote is already everywhere — eigenrobot · 2026-11-16
- Effective Altruism is top-down and hierarchical, not a grassroots movement — ctjlewis · 2026-11-16