ByteDance- and Monash-led paper turns task experience into weights for software agents
imjustnewatai · x · 2026-07-25
A ByteDance Seed and Monash paper proposes an agent-training loop that turns task experience into model weights and then deletes the trace.
The method gives an agent several attempts at a software task, collects its commands, failed patches, test results, and final fixes into an experience trace, then distills that trace into the weights. On 749 software tasks, the results were:
- Base model: 5.3% pass@1
- Normal fine-tuning: 8.0%
- PPO: 17.7%
- Experience distillation: 51.4%
It also used 9.6× fewer environment interactions than PPO. Repeating the collect → distill → erase loop five times raised performance from 7.1 to 47.0. On 494 held-out tasks, including unseen repositories, pass@1 nearly doubled from 4.62% to 8.84%.
The authors stress this is not recursive self-improvement yet: each cycle still needs an offline weight update, and the models were undisclosed in-house systems. But the paper argues that experience may become the next scaling axis for agents.
More from coding & agent
- Claude Code gets a no-ai-slop skill that rewrites drafts and flags AI-sounding prose — aigclink · 2026-07-25
- A reusable multi-agent orchestration prompt for coding workflows and builds — doodlestein · 2026-07-25
- ChatGPT Cowork adds a VM for testing replication materials on a clean machine — RobbWiller · 2026-07-25
- New Rust crate `commit-fix` keeps multi-agent coding trees from stalling on hooks — arthurcolle · 2026-07-25
- Snorkel AI says agent benchmarks should be rebuilt from production traces — AI Engineer · 2026-07-25
- A Reddit thread debates whether “Stack Overflow” is too ambiguous for agent-loop cost — Present-Quantity-813 · 2026-07-25