AI Reproduces 168 ICML Papers, Only 7 Fully Pass

A University of Chicago team used AI agents to reproduce 168 ICML oral papers, including 105 full reproductions. Only 7 papers fully passed the verification, highlighting a significant reproducibility crisis in top-tier AI research.

2026-07-23 ~ 2026-07-23 · 2 related posts

• AI Agents Replicate 168 ICML Papers: Only 7 Completely Hold Up — profjamesevans · 2026-07-23
• AI Agents Replicate 168 ICML Papers, Only 7 Mostly Hold Up — ChenhaoTan · 2026-07-23