Uno paper: discrete diffusion drafting gives lossless LLM speedups without a draft model
rohanpaul_ai · x · 2026-09-09
The arXiv paper "Unlocking Lossless Speedups in LLMs via Discrete Diffusion" introduces diffusion-augmented LLMs (Uno): model parameters are split into standard AR weights (trained with NTP) and lightweight diffusion weights (learned via a Diffusion Distillation phase with negligible overhead), enabling parallel multi-token generation.
- Ψ-Spec, a family of samplers, enables lossless acceleration and inference-time scaling at fixed context length
- Unlike speculative decoding, no separate draft model; unlike diffusion LLMs, quality of the underlying AR model is preserved
- Can be trained from scratch or added to existing open-weight AR LLMs; outperforms leading speculative-decoding throughput at every evaluated batch size
- Author team includes Eric Xing, Zhengzhong Liu, Joel Hestness, and others
Related event: Uno: Discrete Diffusion Delivers Lossless LLM Speedups(4 posts)→
More from Infra
- Dev submits PR adding periodic checkpoints to GKE sandboxes so agents don't lose progress — yoimnotkesku · 2026-11-19
- AWS Lambda Adds GPU Support via Managed Instances for Inference and Media Workloads — DavidWells · 2026-11-19
- Nvidia Allegedly Made GPUs Artificially Scarce to Keep Prices Sky-High — GaryMarcus · 2026-11-19
- Leak Hints at Classified 1M-GPU Training Cluster in China That Skips HBM — teortaxesTex · 2026-11-19
- Tencent leaned on Japanese neocloud for AI compute; DeepSeek, Zhipu best positioned — teortaxesTex · 2026-11-19
- Open-source prefill engine for GLM-5.3-Flash beats vLLM by 3.2x on 4x B200 — CShorten30 · 2026-11-19