Microsoft Tests: Agent Success Rate Drops from 65% to 25% on Repeats
samueljmcd · x · 2026-08-30
Microsoft tested 507 real MCP workflows in a sandbox called Thinkingbox. The agent completed the job 65% of the time on the first try, but that rate fell to 25% when asked to do the same job twenty times in a row.
Key takeaway: A clean tool call is not a completed job. Reliability is the core challenge.
More from coding & agent
- CommerceAgentBench released: Qwen leads open-weight models — Alibaba_Qwen · 2026-09-01
- Agents can't verify people: data enrichment APIs are failing — Dry_Steak30 · 2026-09-01
- Automated User Interview Agent Workflow Integrating Posthog, Notion, and Grok — lennysan · 2026-09-01
- Using Grok Bot to build college admissions dataset pipeline — lennysan · 2026-09-01
- Idea: 'Money Leak Hunter' Grok Bot for finance audit — lennysan · 2026-09-01
- From Discord Bots to a Multiplayer Agent Workspace — steipete · 2026-09-01