ICM slide says most AI capability claims lack controlled scientific evidence
AlexKontorovich · x · 2026-07-25
At ICM 2026, Alex Kontorovich posted a slide emphasizing that many claims about AI capability are not backed by controlled scientific conditions. The slide argues that public evidence is often affected by reporting bias and non-scientific incentives, and that one should separate the truth value of a conjecture from whether it is desirable.
The post is a concise critique of how AI capability claims are argued in public: there may be many data points, but most are not gathered under experimental conditions that would support strong scientific conclusions.
More from AGI Musings
- AI accusations shake literary prizes from Caine to Goncourt: who decides what's human? — TuhinChakr · 2026-10-26
- Tech discovers wargaming: applying to be Anthropic's tabletop exercise lead — round · 2026-10-26
- RSI is the culmination of the industrial revolution: a factory building a faster factory — tobias_rees · 2026-10-26
- NYT roundtable asks five experts what the rules for AI companies should actually be — ShakeelHashim · 2026-10-26
- Anti-AI content is algorithm gold and very profitable, quips commentator — annetgriffin · 2026-10-26
- Silicon Valley breakdown: five Stanford-area giants worth ~$18T — FinanceYF5 · 2026-10-26