Context Language Models: LLMs Edit Their Own Context, Gaining 11.4% Accuracy While Saving 21.5% Compute

Researchers from the University of Washington, Meta Superintelligence Labs, MIT and Trillium Labs (including Rulin Shao, Pang Wei Koh and Luke Zettlemoyer) published Context Language Models (CLM): the model's live context is treated as a file that the model itself decides to keep, delete or move to disk, replacing engineer-written summarization/pruning rules and fixed action menus. A zero-shot CLM outperforms SOTA context-management methods, gaining 11.4% accuracy on BrowseComp while saving about 21.5% compute.

Confirmed

Why it matters

2026-10-03 ~ 2026-10-05 · 7 related posts

Primary sources

3 near-duplicate retellings: RulinShao · datawithsuman · datawithsuman