Microsoft Tests: Agent Success Rate Drops from 65% to 25% on Repeats
samueljmcd · x · 2026-08-30
Microsoft tested 507 real MCP workflows in a sandbox called Thinkingbox. The agent completed the job 65% of the time on the first try, but that rate fell to 25% when asked to do the same job twenty times in a row.
Key takeaway: A clean tool call is not a completed job. Reliability is the core challenge.
More from coding & agent
- Connected steps are not a workflow: nobody designs the handoff — usehive · 2026-10-16
- Making Blender animations with Opus, Astra and Argon: how you prompt still matters — chongdashu · 2026-10-16
- Running PolyStrata + Cline coding agent on a $0-fancy laptop at ~90 tok/s — rpwoerk · 2026-10-16
- How do you attribute agent gains: model training or infrastructure? — jrxna · 2026-10-16
- Feed Claude your books, blogs and top engineers' code for claude.md — 'it now writes better code than me' — blaizedsouza · 2026-10-16
- Open-source /label plugin auto-names and colors Claude Code sessions in one step — hermanschutte · 2026-10-16