2DSD Speculative Decoding Transfers to Diffusion and Flows, Up to 8x Throughput Gain

LucaAmb · x · 2026-11-20

Arnav Chavan notes 2DSD opens a new axis for speculative decoding: results shown on Looped AR transfer to any looped architecture, including Looped AR, Diffusion, and Flows, with up to 8x throughput gains.

Checkpoints are live in a Hugging Face collection and code is open-sourced on GitHub, making looped AR models considerably more practical.

Related event: 2DSD Speculative Decoding Speeds Up Looped LMs Up to 8x(2 posts)→

Original post →

More from Infra

Infra channel →