Researcher Critiques AI Progress Models: Homogeneous Field, Experimenter Degrees of Freedom
VladChituc · x · 2026-11-11
Vlad Chituc raises methodological concerns about formal models of AI progress: despite many models pointing in a similar direction, they come from a fairly homogeneous intellectual monoculture, and such models are particularly sensitive to experimenter degrees of freedom — one can always find justifiable modeling choices that yield the desired answer. The other side counters these models remain our best attempt at understanding an illegible phenomenon.
Related event: Scholars Debate the Value of AI Progress Forecasting Models(7 posts)→
More from AGI Musings
- OpenAI researcher tells healthtech founders: bet on the models getting better — madhavsinghal_ · 2026-11-11
- Anthropic: Claude now leads 26% of its model R&D, up from under 1% in February — RealGeneKim · 2026-11-11
- Living with AI doom: save for the future or spend it all on psychedelics? — flowersslop · 2026-11-11
- Polymarket odds: 8% chance Anthropic fully pauses AI training by end of year — Polymarket · 2026-11-11
- AI Futures Project co-founder Eli Lifland warns humanity could lose control within 3–12 months — Polymarket · 2026-11-11
- OpenAI's Will DePue: the Anthropocene is over — like mammoths meeting humans — willdepue · 2026-11-11