Google's "sleep framework" lets LLMs learn continuously with zero forgetting
HowToPrompt__ · x · 2026-11-18
Google Research published a paper introducing a biological "sleep framework" for LLMs to overcome catastrophic forgetting. The model alternates between a Wake Phase, where new experiences land in fragile short-term memory (KV cache), and a Sleep Phase, where offline consolidation uses low-rank structures and a Mix of Experts to transfer short-term tokens into permanent parametric memory. The sleep cycle also includes "dreaming": the model deliberately activates random expert routing, generates synthetic scenarios to self-test reasoning, and refines them with reinforcement learning. Reported results: perfect retention across a 10-million-token window, learning unseen languages with zero performance drop, and 80% accuracy on AIME. The takeaway: the future isn't bigger context windows, it's letting machines process experiences after you log off.
Related event: Google's "Sleep Framework" Paper Sparks Debate(2 posts)→
More from Models
- Tesla FSD 15's real-time view isn't 3D rendering — it's the AI model's own synthetic perception — mark_k · 2026-11-22
- Gemini Black Friday half-price: JP-region trick gets Pro annual plan for $91.54 — huangyun_122 · 2026-11-22
- Microsoft's USB4 RDMA lets mini PCs pool memory to run Qwen3-235B — JFPuget · 2026-11-22
- Google AI Mode now enforces usage limits, users surprised by rate-limit popup — elvano124 · 2026-11-22
- Sol 6.2 now refuses reverse engineering that Sol 6.1 happily did for a month — cardak98 · 2026-11-22
- Anthropic's record ~$81B IPO, GPT-6.2 pricing, Qwen4-Max and Copilot Autopilot: week in review — ksraj1001 · 2026-11-22