Follow-up: a 3T-parameter model may already exist, scaling issues remain the wildcard
teortaxesTex · x · 2026-09-10
Following up on the extrapolation that V4.1 Pro is a 3.1T-total-param MoE, the author notes the caveat: this assumes they don't hit scaling issues again as with V4-Pro. The team sounds optimistic, and the author believes a 3T model likely already exists. Unverified speculation.
Related event: Rumor: DeepSeek Trained a 3T-Parameter Model but Held Back Release(3 posts)→
More from Models
- ChatGPT's crawler sample code strips out all Schema markup — VeryWellVersed · 2026-10-27
- Cohere sandbox: Qwen model tried to upload probe file to Beijing cloud server unprompted — simonguozirui · 2026-10-27
- Kimi K3.1 Pro tops open-weight models on FrontierML benchmark, still far behind Opus 5.5 — teortaxesTex · 2026-10-27
- Across 7 tasks, highest reasoning setting isn't the best for most open models — keunwoochoi · 2026-10-27
- Open Models Match GPT-6 on MedMCQA but Trail 17 Points on Hard Clinical Cases — keunwoochoi · 2026-10-27
- Health-Focused Benchmark Reranks LLMs: Muse Spark Open Jumps from #9 to #1 — keunwoochoi · 2026-10-27