DeepSeek V4.1 Flash: 890 bytes/token KV cache, 552B MoE beats V4 Pro on agentic tasks
togethercompute · x · 2026-09-13
Together AI has launched DeepSeek V4.1 Flash, with full specs now published:
- Architecture: a multimodal MoE with a Causal Encoder-Decoder design (20 encoder + 20 decoder layers), 552B backbone plus 196B Engram lookup memory; only 8B parameters activate during prefill and 16B during decode, slashing cost for input-heavy agentic workloads.
- KV cache: Compressed Sparse Attention 2 plus FP4 KV caching shrink the global cache to 890 bytes per token — roughly a quarter of DeepSeek V4 Flash — across a 1M-token context.
- Capabilities: natively multimodal, trained from scratch on 45T tokens; reasoning effort continuously adjustable 1–100 per request; leads DeepSeek's published agentic suite, outperforming the much larger V4 Pro, and reportedly beats GPT-5.6 Sol on agentic benchmarks at one-third the cost per task.
- Availability: released under the MIT license, available on Together AI (serverless and dedicated) with a 99.9% SLA.
Related event: DeepSeek V4.1 Flash Launches Open-Source, Beats GPT-5.6 at One-Third Cost(4 posts)→
More from coding & agent
- Stardock's QA now runs agents that play the game and file reports — draginol · 2026-10-31
- Limma MCP structures unstructured data end-to-end so agents never miss a detail — FlimsyIngenuity7248 · 2026-10-31
- Agent audit metric: can you name which tests ran and files changed without reading its summary? — ronbodkin · 2026-10-31
- FlowSense MCP lets Claude Code inspect and firewall your Mac's network traffic locally — hani_q · 2026-10-31
- Dev: coding agent notifications only worth pushing when waiting on approval — petrusenko_max · 2026-10-31
- Unofficial OpenTargets MCP Server Brings Gene-Drug-Disease Data to LLMs — modelcontextprotocol · 2026-10-31