Toby Ord: Gemini 4 Safety Report discloses DeepMind's internal AI-for-AI-R&D efficiency data

tobyordoxford · x · 2026-10-22

Discussing what METR's time-horizon task suite implies about slowing AI progress, Oxford philosopher Toby Ord noted that Google DeepMind ran a very similar analysis on its internal use of AI for AI R&D and published the graph on page 78 of the Gemini 4 Safety Report.

He argues this can be treated as real evidence suggesting that—if real AI R&D work is as hard as METR's task suite—we may be about 14 months behind where one might have expected. But the finding was surprising enough that he thinks it deserves sanity-checking.

Related event: Oxford's Toby Ord: OpenAI's real R&D time horizon is just 1/12 of METR benchmark(8 posts)→

Original post →

More from AGI Musings

AGI Musings channel →