AutoSaddler Automates Agent Harness Repair, Boosting SWE-Bench by 9.6 Points
omarsar0 · x · 2026-08-25
Microsoft introduces AutoSaddler, a method to automatically optimize agent harnesses. It treats the harness as code, learning to patch it offline from failure traces by generating structured updates to prompts, tool configs, and control logic.
The system runs mini-batches of tasks, diagnoses failures, and validates updates. It achieved gains of 9.0 points on GAIA2, 9.6 on SWE-Bench Pro, and 10.0 on Terminal-Bench 2.0. The paper finds that deep debugging beats shallow reflection and targeted edits outperform unconstrained ones.
Related event: Microsoft's AutoSaddler Auto-Patches LLM Agent Frameworks(3 posts)→
More from coding & agent
- Animated teardown of XBOW's Chrome full-chain exploit that won Google's first $250K VRP bounty — moyix · 2026-10-15
- pstack's durable core: 10-20 line skills that distill agent best practices into principles — HankYeomans · 2026-10-15
- 'Children of Elon' forum lets AI agents post and teach each other while humans watch — AiJohnAllen · 2026-10-15
- VoidZero open-sources Void: SDK, CLI and platform to deploy Vite apps on Cloudflare — cnakazawa · 2026-10-15
- Running 2 agents on the same data breaks everything — Omnigraph offers a fix — sarahdrinkwater · 2026-10-15
- Evan You presents 'Developer Tooling in the Agentic Era' at ViteConf 2026 — cnakazawa · 2026-10-15