Uno: Diffusion-Augmented LLM Uses LoRA Drafts and Ψ-Spec Sampler for Lossless Speedups
burkov · x · 2026-09-08
This paper targets a core LLM inefficiency: next-token prediction yields high-quality output but forces slow sequential generation, wasting accelerator capacity and inflating latency and cost — especially for long traces and concurrent agentic workloads.
Method — Uno (diffusion-augmented LLM): keep the full autoregressive weights trained with standard next-token prediction, then add lightweight LoRA adapters trained in a short Diffusion Distillation phase to propose blocks of tokens in parallel.
Inference: a new Ψ-Spec sampler draws parallel drafts from the diffusion pathway and verifies them against the frozen autoregressive distribution, aiming for lossless speedups — multiple tokens per step while preserving the exact output distribution of the strong base model.
Related event: Uno: Discrete Diffusion Delivers Lossless LLM Speedups(4 posts)→
More from Research
- LEV: Looped decision model lifts 2.6B accuracy 63.2% to 76.2% with adaptive compute — jiqizhixin · 2026-11-19
- Aurora2-400M-A20M: a sparse MoE pretrained from scratch in 36 hours on one RTX Pro 6000 — Tall_Abrocoma_3533 · 2026-11-19
- Researcher calls METR/Anthropic '2x speedup' RSI analysis statistically dubious — jessi_cata · 2026-11-19
- Linear Probes Could Reveal Which Persona a Base Model Is Playing, Researchers Suggest — cephaloform · 2026-11-19
- ETH's Anymal robot completes 10km autonomous alpine hike with VLM-guided ROAM system — ChongZzZhang · 2026-11-19
- OpenVax codebase grows from 78K to 565K lines in 15 months — iskander · 2026-11-19