Jason Weston's self-improving memory lifts agent test scores from 36.1 to 56.0
jaseweston · x · 2026-11-17
Jason Weston shares a thread on Self-Improving Memory: the agent runs LOAD before each subtask and OFFLOAD after, with files carrying what was learned. In the Discover step, a meta agent reads trajectories, finds where memory use breaks, and rewrites the LOAD/OFFLOAD prompts; best candidates (5 runs each) become parents for iteration. Optimized harness reaches an avg test score of 56.0 vs 44.6 for the best hand-written version and 36.1 for the generic one. The meta (discover) agent and task agent are the same model (Kimi-K2.6), so the model learns memory skills it discovered itself.
Related event: Meta's Self-Improving Memory Lets Agents Discover and Distill Memory Skills(4 posts)→
More from coding & agent
- How Comet improved a financial incident remediation agent's score from 0.34 to 0.57 with Opik — dl_weekly · 2026-11-17
- Jason Weston: Harness Optimization Hits 56.0, Distillation Adds 5.5 More — jaseweston · 2026-11-17
- Meta's Self-Improving Memory: agents discover their own memory skills and distill them into weights — jaseweston · 2026-11-17
- Every shows Claude Fable 5.2 building interactive games — slow but token-hungry — every · 2026-11-17
- Two free Wan2.1 ComfyUI workflow sets: native nodes vs Kijai wrapper with speed boosts — asdfghmfker · 2026-11-17
- Keeping filler words in prompts encodes real uncertainty and nails it in one shot — brandon_galang · 2026-11-17