Proactive Memory Agent for Long-Horizon Tasks
Md. Shakhoyat Rahman Shujon · hf · 2026-07-11
This work focuses on behavioral state decay in long-horizon tasks: as the trajectory grows longer, the state information critical for decision-making gets scattered across the context or even pushed out of the window, causing the agent to "forget" at crucial moments.
Method: Proactive Memory Agent
- Leaves the original action agent unmodified
- Introduces an additional memory agent
- The memory agent continuously maintains a structured memory bank
- It decides when to inject a contextually relevant reminder to the action agent and when to remain silent
Experimental Conclusions
- This module can be directly attached to frontier action agents and existing harnesses as a plug-and-play solution
- It improves pass@1 on both Terminal-Bench 2.0 and τ^2-Bench
- Benefits both weaker and stronger action agents
- Ablation studies show that selective intervention outperforms passive retrieval, constant injection, advisor-only approaches, and general retrieval
Training Attempts
The authors also trained an open-weight memory policy:
- Utilized SETA data
- Employed SFT + GRPO
- Achieved higher validation rewards with partial transfer to Terminal-Bench
Related event: Meta Proposes Active Memory to Fix Long-Horizon Agent Decay(4 posts)→
More from coding & agent
- Looking for a classifier of software engineering task shapes to pick models per task — StewartalsopIII · 2026-09-11
- Steal this idea: prompt-to-hardware where agents assemble custom devices — paraschopra · 2026-09-11
- Model Is the Least Interesting Part: A Guide to Six Core AI Architectures from RAG to Multi-Agent — goyalshaliniuk · 2026-09-11
- Non-coder builds layered memory architecture: 20k tokens tracks a year of agent conversations — matteoianni · 2026-09-11
- Warp's six non-engineering teams all run on Linear and Claude Code — mon__lim · 2026-09-11
- 9-year backend dev: AI code isn't the problem, the rate of making a mess is — Sweaty-Landscape-561 · 2026-09-11