DeepSeek V4.1 Flash multimodal: 45T image-text tokens and modality-level load balancing
nrehiew_ · x · 2026-09-11
nrehiew covers the first architectural difference of DeepSeek V4.1 Flash — multimodality:
- Pretrained on 45T image-text tokens
- Custom image encoder
- Load balancing at the modality level
The last point echoes the original Chameleon paper: tokens from different modalities may compete and interfere with each other.
More from Models
- Forcing models to always max effort is like humans evolving on Adderall, researcher argues — voooooogel · 2026-09-11
- Pushing models to always show 'maximum effort' drags along its corollaries, dev argues — voooooogel · 2026-09-11
- Claude is the distillation target of choice because agentic RL seed data is scarce — teortaxesTex · 2026-09-11
- Why Chinese labs distill from Anthropic: Claude's agent data is the scarce training signal — teortaxesTex · 2026-09-11
- ApprenticeBench: closed model scores 72% vs open Kimi K3 at 18% on real jobs — ysu_nlp · 2026-09-11
- CursorBench 4.0 launches; Muse Spark 1.3 matches Sol at under 40% the cost — jyangballin · 2026-09-11