DeepSeek releases V4.1-Flash: 552B MoE with 1M context, KV cache cut to 890 bytes/token
deepseek-ai · hf · 2026-09-18
DeepSeek released V4.1-Flash, a multimodal 552B-parameter MoE model supporting 1M-token contexts, with checkpoints on Hugging Face. Its Causal Encoder-Decoder architecture activates 16B params per token at decode but only 8B at prefill, targeting input-heavy agentic workloads. By combining cross-layer KV reuse (CSA2) with FP4 KV caching, its global KV footprint drops to 890 bytes/token—about 1/4 of DeepSeek-V4-Flash—and SWA Bounded Replay cuts the persistent SSD/host-memory KV footprint to 1/8, all while outperforming the baseline. Pretrained on 45T multimodal tokens.
More from Infra
- SurrealDB 4 launches as multi-model ACID database for the agentic era — Scobleizer · 2026-11-04
- Fire at Taiwan Panasonic PCB materials plant may tighten CCL supply further — zephyr_z9 · 2026-11-04
- AMD CEO Lisa Su says revenue to grow over 80% in 2027, data center to top 80% of sales — AccBalanced · 2026-11-04
- Self-improving software is inevitable: closing the agent-observability loop — bibryam · 2026-11-04
- Gigabyte's AI TOP motherboard packs 2TB RAM and 9 GPUs for home AI labs — vincent_koc · 2026-11-04
- Building a 7-GPU 132GB VRAM local inference rig: consolidate on EPYC or split across two systems? — infectiousstupidity · 2026-11-04