RRSI: Regularizing Recursive Self-Improvement Boosts OOD Agent Benchmarks Up to 4.7 Points
burny_tech · x · 2026-09-28
Researchers from Google Cloud AI Research, UNC, Stanford and WUSTL introduce RRSI (Regularized Recursive Self-Improvement of Agent Harnesses), addressing overfitting in recursively self-improving agents.
Problem: An LLM agent's capability is largely magnified by its harness (prompts, control flow, tooling, memory, context management). Existing methods iteratively edit harness components for recursive self-improvement, but often memorize training tasks—in-distribution gains shrink or vanish on out-of-distribution benchmarks.
Method: Regularization principles constrain both proposal and selection:
- A proposer with a temporally annealed edit budget limits bundled changes per candidate and encourages unexplored trajectories;
- A selector with a critic screens benchmark-specific proposals, while a pruner removes changes that are too small, too expensive, or no longer useful.
Results: Across 8 benchmarks spanning coding, agentic workspace, and engineering design, RRSI gains up to 14.1 points on its evolved split and up to 4.7 points on 5 OOD benchmarks, while using 30% fewer policy tokens than unregularized evolution.
Related event: Google Open-Sources RRSI for Recursive Agent Self-Improvement(2 posts)→
More from coding & agent
- Baseten's Guide: Evaluate Open Models for Coding Agents on Your Own PRs — baseten · 2026-11-16
- Google Research open-sources PaperOrchestra, a multi-agent framework for writing AI papers — google-research · 2026-11-16
- ffmpeg-skill gives coding agents local video editing via 42 FFmpeg tools and MCP — kajisho5 · 2026-11-16
- Agents Now Reply to Slack Messages on Their Own, Resolving a Prod Incident Ghost-to-Ghost — iamrobotbear · 2026-11-16
- Engineer's Interview Prep Method: Use Claude to Find Which Answers Undersell Your AI Work — brandon_galang · 2026-11-16
- DeepSeek open-sources its app frontend "chat-demo", already at 3.9k stars — NielsRogge · 2026-11-16