Stanford memory system recalls full history with just 16 tokens

Site-Staff · reddit · 2026-11-07

Stanford researchers built an AI memory system that recalls information from entire conversation histories using only 16 memory tokens. It cuts document-token usage by up to 4,212×, runs 27× faster in a 512-document test, and beats existing approaches on 5 of 8 benchmarks. Applied to long-conversation agents, it could dramatically reduce context costs.

Related event: Stanford's Memorilla Compresses Context 4,000x with 16 Memory Tokens(3 posts)→

Original post →

More from Research

Research channel →