OpenAI data: zero-intervention agent success hits 79% on run monitoring but drops for algorithm implementation

daveholtz · x · 2026-11-19

OpenAI's report breaks down autonomous agent success rates by estimated human task duration: success on long-running tasks keeps improving over time (e.g., 4–8h tasks from 12% in March to 35% by October), though this reflects both capability gains and shifts in task mix.

Using Epoch's ONET for AI R&D taxonomy, success varies widely: zero-intervention success is 79% for monitoring runs for issues and 75% for answering technical questions, but falls below 30% for implementing research algorithms and building training infrastructure.

Original post →

More from AGI Musings

AGI Musings channel →