Model reportedly uses QAT for KV cache, explaining strong fp4 performance while dropping MTP
stochasticchasm · x · 2026-09-11
An observer notes the new model applies quantization-aware training (QAT) to the KV cache as well, which explains its better-than-peers performance at fp4 KV cache. The author also noticed MTP (multi-token prediction) was removed, speculating the performance uplift wasn't ultimately worth it.
Related event: Leaked DeepSeek V4.1 Flash Tech Report Reveals KV Cache-Obsessed Flagship(44 posts)→
More from Infra
- Grid queues make power architecture an AI-factory decision; Exowatt and Redwood offer fixes — ingliguori · 2026-10-27
- Two CVSS 9.9 Wasmtime flaws allow sandbox escape, one ARM64-only since 2020 — basedjensen · 2026-10-27
- AI Infra Meme: While Countries Need TW-Scale Power for Datacenters, People Argue About Lightbulbs — mgostIH · 2026-10-27
- NVIDIA reportedly stops taking RTX 5090 orders from board partners, even backorders — chemist_slime · 2026-10-27
- Legora runs 2,000 parallel agent evals on Modal Sandboxes for legal AI — blelbach · 2026-10-27
- Cloud release velocity scores: AWS 95, Azure 90, Google Cloud 82 — DavidLinthicum · 2026-10-27