ICM slide says most AI capability claims lack controlled scientific evidence
AlexKontorovich · x · 2026-07-25
At ICM 2026, Alex Kontorovich posted a slide emphasizing that many claims about AI capability are not backed by controlled scientific conditions. The slide argues that public evidence is often affected by reporting bias and non-scientific incentives, and that one should separate the truth value of a conjecture from whether it is desirable.
The post is a concise critique of how AI capability claims are argued in public: there may be many data points, but most are not gathered under experimental conditions that would support strong scientific conclusions.
More from AGI Musings
- 'AGI is here' vs reality: AI labs still ship some of the jankiest desktop apps ever — MilesCranmer · 2026-09-11
- Misquoted: Anthropic Staff Warned of Double-Digit Extinction Risk by 2030, Not Dismissed It — davidmanheim · 2026-09-11
- Economist Ben Moll: You Can Model Anthropic's 15% AI GDP Growth, But It Won't Happen — sebkrier · 2026-09-11
- Cohere Labs launches interactive tool mapping which tasks of 178 occupations AI can automate — Cohere_Labs · 2026-09-11
- AI researcher on SkyNews flags concerns over inequality, power and criminal misuse — schwarzjn_ · 2026-09-11
- VC compares AI doom rhetoric to pandemic-era fear messaging — StewartalsopIII · 2026-09-11