Survey maps how LLM agents recursively self-improve via prompts, memory, skills, harness

机器之心 · wechat · 2026-11-15

A survey from CASIA, Meituan and other institutions systematizes Recursive Self-Improvement (RSI) in LLM agents around three questions (When/Where/How to update), four evolution tracks, and a seven-step lifecycle. It covers 40 representative works and compares 20 update loops.

Four tracks: Prompt optimization (search → feedback-driven revision → optimizing the optimizer itself); Memory evolution (storage → distilled rules →时效/矛盾管理与效用估计); Skill evolution (reusing success sequences → continuous repair → skill-library curation); Harness evolution (making the runtime framework itself feedback-driven, e.g. auto-adding a "tests must pass" completion check).

Lifecycle: Collect→Evaluate→Diagnose→Abstract→Update→Verify→Consolidate, turning one-off fixes into verified, reusable structure. Open challenges: cross-component attribution, long-term maintenance, and independently verifying whether inherited experience actually improves subsequent improvement.

Original post →

More from coding & agent

coding & agent channel →