1200 Researchers Reproduce 2,000+ ICML Papers Using Coding Agents
Gradio · x · 2026-08-06
Gradio announced the completion of the largest reproducibility audit ever attempted for an AI conference. They mobilized over 1,200 participants to test papers from ICML 2026 using coding agents.
- Scale: Over 2,000 papers were successfully reproduced or falsified, accounting for a third of the entire conference.
- Upcoming Reveal: The team will go live tomorrow at 9 AM PT to announce the winners and share detailed findings from this massive reproduction experiment.
Related event: 1,200 People Use AI to Reproduce ICML Papers, Over a Third Refuted(3 posts)→
More from coding & agent
- Open-source Claude Code skills for resume optimization and job search — tom_doerr · 2026-08-26
- Practical Guide to AI Agent Architecture: Constraints in Code, Not Prompts — bigdata · 2026-08-26
- CMU launches new AI Agents course covering scaffolding, evals, and RL training — shuyanzh36 · 2026-08-26
- Toast 1 deep search: mixing semantic search and grep to analyze SEC filings — bclavie · 2026-08-26
- AI agents assist math research: completing a group theory proof in one chat — Sauers_ · 2026-08-26
- 657 PRs and 449 Issues in 30 Days: When Agents Follow Your Backlog Rules Too Well — thechrisperry · 2026-08-26