Diffusion-augmented LLM Uno delivers lossless 2.2x speedup over autoregressive generation
HongyiWang10 · x · 2026-09-18
IFMAI introduces Uno, a diffusion-augmented LLM aimed at the sequential token-by-token inference bottleneck of autoregressive models.
Key ideas:
- Parameters are split into standard NTP-trained AR weights plus lightweight diffusion weights that draw multiple tokens in parallel
- The diffusion weights are learned via a simple Diffusion Distillation phase with negligible overhead to existing training pipelines
- A family of samplers, Ψ-Spec, enables lossless acceleration and inference-time scaling at fixed context length — no draft model (unlike speculative decoding) and no quality loss (unlike diffusion LLMs)
Results: Uno can be trained from scratch or bolted onto open-weight AR LLMs; K2-Horizon-7B beats SOTA diffusion methods on both quality and throughput with up to 2.2x speedup, and outperforms leading speculative-decoding throughput at every evaluated batch size. Paper on arXiv (2609.04010), model released.
Related event: IFM AI's Uno: Diffusion-Augmented LLM Delivers Lossless 2.2x Speedup(2 posts)→
More from Research
- Boltz Lab reveals 50x molecular token growth in 5 months as Series A closes — GabriCorso · 2026-11-19
- Researcher calls METR/Anthropic '2x speedup' RSI analysis statistically dubious — jessi_cata · 2026-11-19
- Linear Probes Could Reveal Which Persona a Base Model Is Playing, Researchers Suggest — cephaloform · 2026-11-19
- ETH's Anymal robot completes 10km autonomous alpine hike with VLM-guided ROAM system — ChongZzZhang · 2026-11-19
- OpenVax codebase grows from 78K to 565K lines in 15 months — iskander · 2026-11-19
- François Fleuret: decoder transformer's elegance — no trade-off hyperparameters — francoisfleuret · 2026-11-19