Why orchestrator LLMs also go OOD: how CodeAct/MemGPT/RLM curb context rot
a1zhang · x · 2026-11-20
a1zhang explains the paper's motivation: most tasks are decomposable (like MapReduce), but mainstream harnesses use "trajectory-as-a-prompt," stuffing all history into context — and LLMs generalize unreliably, causing context rot. Crucially, even the LM orchestrating sub-agents can go OOD, a common failure of long-running coding sessions. Harness abstractions like CodeAct, MemGPT, RLMs, and CLMs avoid this by enforcing how context moves and what each LLM call sees.
Related event: MIT Paper: LM Harnesses Are Compositional Generalizers, Not Crutches(10 posts)→
More from coding & agent
- Build a 'company brain': one shared knowledge base for your whole team's AI — VibeMarketer_ · 2026-11-21
- LangChain ships four updates: LangSmith Agent Platform, trace data controls, Tool Gateway — LangChain · 2026-11-21
- Stanford CS329Z: Full AI Agents Course Free With Slides, Videos, Homework — stanfordnlp · 2026-11-21
- Grok Bot Gets Its Own Email Addresses to Sign Up and Handle Promos for You — elonmusk · 2026-11-21
- CapCut × ChatGPT plugin turns chat into a video generator and editor — SimplyAnnisa · 2026-11-21
- Princeton & Meta's Strategist evolves inference strategies, beating baselines on 24/30 benchmarks at 39% lower cost — 141_1337 · 2026-11-21