Continuous Diffusion LMs: One-hot Flow Jumps From 4% to 50% on TinyGSM

brandondamos · x · 2026-10-14

New research on continuous diffusion language models (CDLMs) improves one-hot flow from 4% to 50% on TinyGSM without self-conditioning, and systematically explores the design space — questioning why self-conditioning is used and how tokens should be embedded. The authors note CDLMs went from niche to contender this year.

Original post →

More from Research

Research channel →