NVIDIA Open-Sources Sigma, First Large-Scale Continuous Diffusion Language Models
NVIDIA's Nemotron Labs released Sigma on Hugging Face, the first large-scale continuous diffusion language models (3B/8B, 14 weights) trained with a likelihood objective, bringing continuous diffusion from vision into language modeling with block parallel decoding.
2026-11-17 ~ 2026-11-17 · 3 related posts
- NVIDIA releases Nemotron-Labs-Sigma: 8B/3B continuous diffusion LMs with block-parallel decoding — jacek2023 · 2026-11-17
- NVIDIA team releases Sigma: first large-scale continuous diffusion LM with 3B/8B checkpoints — LucaAmb · 2026-11-17
- NVIDIA open-sources Nemotron-Labs-Sigma: continuous diffusion LMs with 4-step distillation — ArashVahdat · 2026-11-17