Diffusion Models: Two Distinct Lineages Converge

drscotthawley · x · 2026-08-31

This post explores the two distinct lineages of diffusion models: the physics/MCMC path (Welling ’11 ➡️ Sohl-Dickstein ’15 ➡️ Song ’19) and Vincent 2011’s pre-training approach. Ho 2020 brilliantly proved that the Langevin trajectory and Vincent’s loss are identical.

Original post →

More from Research

Research channel →