NVIDIA releases Nemotron-Labs-Sigma: 8B/3B continuous diffusion LMs with block-parallel decoding

jacek2023 · reddit · 2026-11-17

NVIDIA released Nemotron-Labs-Sigma (8B/3B, base + instruct) on Hugging Face — continuous diffusion language models that denoise Gaussian noise in a 16-D continuous token-embedding space instead of generating token by token, with the denoiser and embeddings trained jointly via likelihood optimization.

Key details:

Base models target research on parallel decoding, fine-tuning and distillation; instruct variants are for chat. Commercial use allowed.

Related event: NVIDIA Open-Sources Sigma, First Large-Scale Continuous Diffusion Language Models(3 posts)→

Original post →

More from Models

Models channel →