Toby Ord: METR's 50% Time Horizon Can Go to Infinity Without Transforming the World
tobyordoxford · x · 2026-11-09
In a discussion with Ben Todd, Toby Ord argues that METR's 50% task-completion time horizon is an example of a metric that can rise to infinity without the world changing much. A similar curve plotted with AECI would likely be more meaningful, he notes — highlighting the gap between benchmark progress and real-world impact.
More from AGI Musings
- Anti-AI Arguments Are Arguments Against Intelligence Itself: A Four-Point Case — JHochderffer · 2026-11-09
- Making up numbers transparently beats hiding behind vibes, researcher argues in EA debate — davidmanheim · 2026-11-09
- Study: AI chats introduce a new vendor in two-thirds of software buying conversations — VeryWellVersed · 2026-11-09
- Hot take: good AI judgment is now the new median reviewer — 3scorciav · 2026-11-09
- AI insider warns public perception will worsen as frontier progress outpaces intuition — manosaie · 2026-11-09
- NYU paper: AI assistants push retail investors into index funds by 7.6pp — danielrock · 2026-11-09