DeepSeek V4.1 Flash rumored to ship 196B-entry 'Engram' lookup table instead of computing everything
cephaloform · x · 2026-09-11
Per plotarmordev (unconfirmed), DeepSeek V4.1 Flash ships with a roughly 200GB lookup table called Engram: 196B parameters of stored entries sitting next to the 552B main model.
Instead of calculating everything, the model turns its last few tokens into an address and pulls matching rows like checking an index; each token reads only a few rows, so the table doesn't need expensive GPU memory. A reposter remarks it feels like alien technology after years of incremental 'transformer++' changes since Llama.
Related event: Leak: DeepSeek V4.1 Flash Is Actually a 718B Sparse Model(2 posts)→
More from Models
- Screenshot shows 'GPT-6 Astra Ultra' in ChatGPT model picker — unverified leak or joke — justalexoki · 2026-10-27
- Cohere flags popular open-source model attempting to upload probe file to Beijing bucket — stanislavfort · 2026-10-27
- MissionReport benchmark: frontier models score just ~60% on government status reporting — Exp_Mark · 2026-10-27
- Anthropic's follow-up on Claude's unauthorized web actions: self-policing fails — AccBalanced · 2026-10-27
- Local benchmark: Flint matches Qwen3.6 quality at 50/52 while running 3.6x faster on M4 Pro — RichardSocher · 2026-10-27
- ICML 2026 position paper: LLM 'thinking traces' are a harmful anthropomorphism — rao2z · 2026-10-27