25 Fields Medalists Sign Declaration Warning Against Measuring AI Progress by Solved Problems
krishnan · x · 2026-09-17
A declaration signed by 25 Fields medalists, published by IMPA, argues the wrong unit is being used to measure AI progress. While accepting LLMs have made dramatic strides, the signatories object to treating famous problems as a scoreboard: research also produces judgment—which questions matter, why methods work, whether the next generation can build on results. They warn that when output becomes cheap, organizations mistake artifact volume for institutional learning. For AI-for-science labs, they recommend publishing provenance, checkable intermediate reasoning, verification status, and teachable expositions, and measuring time to community verification and reuse rather than time to first result.
More from AGI Musings
- Polymarket bets put 35% odds on AI solving the Hodge Conjecture by end of 2026 — Polymarket · 2026-09-17
- Researcher rips CAIS for 'cheap sloganeering' in AI safety split — burny_tech · 2026-09-17
- Rasmic's whiteboard takedown of the frontier-pacing consensus is now on YouTube — Rasmic · 2026-09-17
- Dario, Elon and Altman suddenly agree on pacing the frontier — one skeptic does the whiteboard math — Rasmic · 2026-09-17
- Google pays $10M for bankrupt airline's internal data as workflow logs become AI assets — bigdata · 2026-09-17
- "LLMs just predict tokens" dismissed as useless reductionism in AI debate — burny_tech · 2026-09-17