Only 7 of the replicated ICML 2026 oral papers mostly held up, thread says
ChenhaoTan · x · 2026-07-24
A post about a replication project claims that, after reproducing ICML 2026 oral papers, only 7 of them mostly held up.
The quoted thread argues that as AI agents make long-horizon research work faster, the field should rethink its incentives and verify science rather than just produce more of it. The response praises tools that help reproduce papers because they preserve the quality and authority of research in a faster-moving cycle.
One comment also notes that the project was reportedly sponsored with $2.2 million, calling that a meaningful investment in research verification.
Related event: AI Agents Reproduce ICML Papers: Only 7 Out of 168 Fully Hold Up(5 posts)→
More from Research
- GameWorld wins Best Paper Runner-Up at ECCV 2026 Multimodal Digital Agents Workshop — MikeShou1 · 2026-09-11
- 3D ResNet Paper Crosses 3,000 Citations Eight Years After CVPR 2018 — HirokatuKataoka · 2026-09-11
- Sample selection and ordering matter a lot in LLM training: DataFlex makes data scheduling dynamic — Puzzleheaded_Box2842 · 2026-09-11
- Jeff Heaton's Intro to the Math of Neural Networks eBook Is Free to Download — blaizedsouza · 2026-09-11
- Mathematician Daniel Litt Launches Problem Repo to Track Human vs AI Progress: 15 Problems, 1 Solved — littmath · 2026-09-11
- Open ECDSA.fail challenge uses AI agents to shrink Shor's-algorithm quantum circuits for Bitcoin keys — StefanoGogioso · 2026-09-11