Simplex Diffusion Models Tackle Information Collapse in Discrete Diffusion

Valentin De Bortoli, Arnaud Doucet et al. propose Simplex Diffusion Models (SDMs), which run discrete diffusion on the probability simplex to preserve uncertainty and avoid the information collapse caused by categorical token sampling in standard discrete diffusion models.

2026-09-30 ~ 2026-09-30 · 2 related posts

• Simplex Diffusion Models proposed to fix information collapse in discrete diffusion — msalbergo · 2026-09-30
• Simplex Diffusion Models: lifting discrete diffusion to the probability simplex to stop information collapse — ArnaudDoucet1 · 2026-09-30