Four-Year Study: Experts Including Superforecasters Repeatedly Underestimated AI Progress
Afinetheorem · x · 2026-09-24
ResearchFRI shares interim findings from the most comprehensive series of studies on expert AI forecasts run over four years. Experts—top economists, computer scientists, biologists—dramatically underestimated AI capability progress every year, and superforecasters underestimated it even more. Track records on diffusion measures were mixed: AI revenue forecasts were major underestimates while electricity-share forecasts are on track. Notable overestimates include mid-2025 models' ability to help amateurs with biorisk lab tasks and the rollout speed of self-driving cars. It's too soon to judge long-run forecaster performance.
More from AGI Musings
- AI slowdown crowd hits 2027 to find the progress curve only getting steeper — Dr_Singularity · 2026-09-24
- Running models 24/7: we're in the harness phase, not autonomous builders yet — BLUECOW009 · 2026-09-24
- The Death of Apps Has Already Begun as AI assistants absorb app UIs — rseroter · 2026-09-24
- Philosopher Peter Godfrey-Smith on non-human AI consciousness and existential risk — AnnaCiaunica · 2026-09-24
- Mat Dryhurst calls out viral reposted quotes as AI slop with bot applause — matdryhurst · 2026-09-24
- Aesona's founding thesis: your 'second self' AI model must be owned by you — aaron_lou · 2026-09-24