Memorilla: Memory System Cuts Tokens 4000x, 27x Faster Than Full Context

ShirleyYXWu · x · 2026-11-06

Memorilla is a new LLM memory system that converts long textual inputs and agent trajectories into latent inputs for a frozen LLM, no training required. The authors claim up to 4000x fewer input tokens and 27x faster inference than full-context, while staying accurate — pitched as memory as a modality for LLMs.

Related event: Memorilla: 16 Memory Embeddings Replace Full-Context LLM Inference(2 posts)→

Original post →

More from coding & agent

coding & agent channel →