Meta and UvA improve discrete flow matching with easier-token prioritization

burkov · x · 2026-07-26

Researchers from @AIatMeta and @UvAAmsterdam propose a way to make diffusion-style discrete generation more practical by prioritizing easier, better-supported token positions during generation and training. The method preserves any-order generation, can be applied to a pretrained model with no extra training and almost no overhead, and reduces generative perplexity by up to 63% on OpenWebText while also improving validity and novelty in molecule generation.

Related event: Meta and UvA Introduce Context-weighted Discrete Flow Matching(2 posts)→

Original post →

More from Models

Models channel →