ByteDance- and Monash-led paper turns task experience into weights for software agents
imjustnewatai · x · 2026-07-25
A ByteDance Seed and Monash paper proposes an agent-training loop that turns task experience into model weights and then deletes the trace.
The method gives an agent several attempts at a software task, collects its commands, failed patches, test results, and final fixes into an experience trace, then distills that trace into the weights. On 749 software tasks, the results were:
- Base model: 5.3% pass@1
- Normal fine-tuning: 8.0%
- PPO: 17.7%
- Experience distillation: 51.4%
It also used 9.6× fewer environment interactions than PPO. Repeating the collect → distill → erase loop five times raised performance from 7.1 to 47.0. On 494 held-out tasks, including unseen repositories, pass@1 nearly doubled from 4.62% to 8.84%.
The authors stress this is not recursive self-improvement yet: each cycle still needs an offline weight update, and the models were undisclosed in-house systems. But the paper argues that experience may become the next scaling axis for agents.
More from coding & agent
- Warp's six non-engineering teams all run on Linear and Claude Code — mon__lim · 2026-09-11
- Is inference latency becoming the biggest bottleneck for production AI agents? — Euphoric_Sea632 · 2026-09-11
- Anthropic researcher: 99% of engineers now run swarms of 300+ self-improving agents — AlishaOutridge · 2026-09-11
- Gergely Orosz: Shipping 10x PRs With AI Agents, Sites Fill With Small Regressions — ducha_aiki · 2026-09-11
- Same Echo Maze prompt, three frontier models: all passed visually but shipped the same hidden bug — eyishazyer · 2026-09-11
- Astra storyboards plus Minimax H3 per-shot generation boost video success rates — Hailuo_AI · 2026-09-11