Leak: DeepSeek V4.1 Pro ~2T params, trained sparse from scratch with no instabilities
teortaxesTex · x · 2026-10-03
Insider chatter (unverified): DeepSeek's V4.1 recipe reportedly shows no training instabilities and sparse-from-scratch works well, so they plan to scale it — V4.1 Pro is said to be 2T params (more with engrams), while the 8T model's design isn't settled. DeepSeek considers Kimi's approach inferior since Moonshot can't serve a 2.8T dense-compute model at volume, and Zhipu struggles with scaling; DS wants a recipe that scales yet stays cheap.
Related event: Leak: DeepSeek V4.1 Pro ~2T Params, Skeptical of Kimi's Path(2 posts)→
More from Infra
- Gridline launches one-API fine-tuning, distillation and batch inference for open models — Scobleizer · 2026-11-19
- Ascend output could hit ~20M chips next year; memory and packaging, not logic, are the bottleneck — teortaxesTex · 2026-11-19
- AMD Loom boosts Qwen3.5-4B prefill up to 2.6x on Radeon 890M laptops — jfowers_amd · 2026-11-19
- Dev submits PR adding periodic checkpoints to GKE sandboxes so agents don't lose progress — yoimnotkesku · 2026-11-19
- AWS Lambda Adds GPU Support via Managed Instances for Inference and Media Workloads — DavidWells · 2026-11-19
- Nvidia Allegedly Made GPUs Artificially Scarce to Keep Prices Sky-High — GaryMarcus · 2026-11-19