AI coding agents complete fewer than 1 in 10 tasks in simulated workplace test

The Decoder · rss · 2026-11-22

The Decoder reports on a new real-world benchmark that places AI coding agents in a simulated developer job with colleagues, project boards, and incomplete handoffs, requiring them to keep developing software autonomously and reliably close open tickets in messy daily workflows.

Even top models like Opus 5.5 and Astra solved fewer than one in ten tasks completely. The models handle clear, standalone assignments quickly, but lose track of context as autonomous developers — highlighting the large gap between isolated benchmark scores and real workplace performance.

Original post →

More from coding & agent

coding & agent channel →