Only 7 ICML 2026 oral papers mostly held up in a new replication test
ChenhaoTan · x · 2026-07-23
Chenhao Tan points to SAI Review, a replication test built on OpenAIReview and Veritas, which checks ICML 2026 oral papers for reproducibility.
In the linked article, the author argues that as AI agents get better at long-horizon work, the research ecosystem could shift toward verifying science rather than only producing it. Their replication effort found that only 7 papers mostly held up, suggesting a large gap between published claims and what can actually be reproduced.
Related event: AI Agents Reproduce ICML Papers: Only 7 Out of 168 Fully Hold Up(5 posts)→
More from Research
- Fortnow: P vs NP beyond AI's reach, but NP vs L separations could fall — fortnow · 2026-09-11
- MaP-WAM tackles non-Markovian robot manipulation with memory-grounded planning — Sizhe Zhao · 2026-09-11
- Negative Self-Distillation improves LLM reasoning by avoiding flawed reasoning paths — Rongcan Pei · 2026-09-11
- DeepMind-led paper makes design docs the source of truth, code disposable — SMART regenerates in 1.5-3h for ~$100 — Roger_M_Taylor · 2026-09-11
- GameWorld wins Best Paper Runner-Up at ECCV 2026 Multimodal Digital Agents Workshop — MikeShou1 · 2026-09-11
- Yann LeCun live at ECCV on World Models — Weak_Assistance_5261 · 2026-09-11