DeepSeek V4.1 Flash halves KV cache with YOCO-style decoder-decoder design
nrehiew_ · x · 2026-09-11
nrehiew explains the core design of DeepSeek V4.1 Flash: 20-layer encoder plus 20-layer decoder. Since prefill is expensive, the bottom half builds the KV cache, which is shared with upper half layers via per-layer projection — roughly a state read individually by later layers. Inspired by YOCO, hence "decoder-decoder" with both modules causally masked; this doesn't apply to the SWA layers.
Related event: Leaked DeepSeek V4.1 Flash Tech Report Reveals KV Cache-Obsessed Flagship(44 posts)→
More from Infra
- Unconventional AI acquires inference chip firm NeuReality in 1,000x efficiency bid — NaveenGRao · 2026-10-27
- Musk: robot RAM demand will dwarf everything else, and 100% of superintelligence compute goes to deep space — elonmusk · 2026-10-27
- RTX 5090 hits $7K as PC gaming community goes into 'denial' over AI boom — PAstynome · 2026-10-27
- Wan2GP lands on Pinokio: 1-click AI video on 6GB GPUs — cocktailpeanut · 2026-10-27
- AWS on agent prompt caching: explicit + implicit patterns to slash token costs — AWS ML Blog · 2026-10-27
- Thieves spoofing GPS steal $100M+ in data center cargo since June — Ars Technica AI · 2026-10-27