NVIDIA open-sources Nemotron-Labs-Sigma: continuous diffusion LMs with 4-step distillation

ArashVahdat · x · 2026-11-17

NVIDIA released an update to Nemotron-Labs-Sigma, a family of open-weight language models bringing continuous diffusion to language modeling: 14 checkpoints at 3B/8B, 16-D smooth ODE trajectories enabling distillation and steering (8 TPFs for math, 4 TPFs for code), strong distillation with just 4 sampling steps, and 3.5× faster speculative decoding. All checkpoints and code are released.

Related event: NVIDIA Open-Sources Sigma, First Large-Scale Continuous Diffusion Language Models(3 posts)→

Original post →

More from Models

Models channel →