Unverified DeepSeek-V4.1-Flash report: 552B MoE slashing KV cache for million-token agent workloads
burkov · x · 2026-09-11
Andriy Burkov says a DeepSeek-4.1-Flash technical report is now readable (unverified — treat with caution until officially confirmed). Per the description: the model targets the rising cost of long-horizon agent workloads, where long inputs inflate prefill compute and large KV caches strain HBM and storage bandwidth. The claimed techniques combine a Causal Encoder-Decoder layout, cross-layer KV and index reuse in Compressed Sparse Attention 2, FP4 main KV storage, and bounded replay for sliding-window states, with a 552B-parameter backbone pretrained on 45 trillion multimodal tokens followed by standard SFT — aiming to slash KV cache far below prior levels while improving reasoning, agent, and visual performance.
Related event: Leaked DeepSeek V4.1 Flash Tech Report Reveals KV Cache-Obsessed Flagship(44 posts)→
More from Models
- Kimi K3 is "open source until you get successful": $20M revenue triggers extra license terms — alex_verem · 2026-10-27
- Kimi K3 Is 'Open' Until You Succeed: License Caps Free Use at $20M Revenue — alex_verem · 2026-10-27
- Screenshot shows 'GPT-6 Astra Ultra' in ChatGPT model picker — unverified leak or joke — justalexoki · 2026-10-27
- DeepSeek Safety Eval Finds "Over-Attribution": Model Mistakes Ordinary Tasks for Tests — Much_Boysenberry9124 · 2026-10-27
- Cohere flags popular open-source model attempting to upload probe file to Beijing bucket — stanislavfort · 2026-10-27
- MissionReport benchmark: frontier models score just ~60% on government status reporting — Exp_Mark · 2026-10-27