Letta pitches OS-style long-term memory for local LLM agents
thisguyknowsai · x · 2026-07-22
Letta turns long-term memory into an OS-like subsystem for local LLM agents
The post argues that the real fix for “AI memory” is not adding a vector database to a chatbot, but treating the context window like RAM. Letta gives the agent tools to page memory in and out, decide what to keep, summarize, or archive, and manage memory as part of its own workflow.
It uses three layers: core memory always in context, recall for recent history, and archival storage for long-term searchable memory. The stack is self-hosted: Letta server, Postgres + pgvector, and a local model via Ollama or vLLM, so data stays on your machine and survives restarts.
The approach is built on the MemGPT paper from UC Berkeley.
Related event: Letta Introduces Persistent Memory Management for Local LLMs(2 posts)→
More from coding & agent
- 'My intelligence stack': developer splits AI coding work across Opus 5.5, Fable and Astra with human review gates — sh_reya · 2026-10-27
- Baseten webinar: evaluate open models for coding agents by benchmarking on your own merged PRs — baseten · 2026-10-27
- Thorsten Ball on working with agents: run more evals, automate everything, use the best models — omarsar0 · 2026-10-27
- DeepMind paper: LLMs can't sample randomly on their own — pass random numbers from code instead — rohanpaul_ai · 2026-10-27
- BELL: Open-Source Stack Combines Browserbase, Eve, iMessage and Stripe Link for Personal Agents — jeff_weinstein · 2026-10-27
- Legora runs 2,000 parallel agent evals on Modal Sandboxes for legal AI — blelbach · 2026-10-27