Uno pairs AR weights with diffusion LoRA adapters, beating EAGLE-3 and all diffusion LLMs
HongyiWang10 · x · 2026-09-05
IFM released K2-Horizon-7B-Uno, a diffusion-augmented LLM that keeps the AR architecture but adds per-layer LoRA diffusion adapters enabling lossless parallel sampling. It outpaces all speculative decoding methods (DFlash, EAGLE-3) and beats every diffusion LLM (Mercury 2, Diffusion Gemma, Llada), scoring 70.1 on SWE-bench Verified and 93.0 on AIME-24 at 2.71 average TPF. Weights (LoRA adapter, Apache 2.0) are on Hugging Face.
More from Research
- Gemini Agents Crack 59-Year-Old Fusion Math Conjecture in Hours — DynamicWebPaige · 2026-10-21
- TrackEverything: CMU and Meta open-source a 3D tracker for all points in 1000+ frame videos — AdamWHarley · 2026-10-21
- Infantconnect: open-source infant brain anatomy and EEG connectivity tool from 1 to 72 months — Dr_Alex_Crimi · 2026-10-21
- Berkeley wins Schmidt Sciences HAVI grant to decode whale and parrot communication with AI — begusgasper · 2026-10-21
- Stanford CS336 Lecture 6: fused Triton kernels cut softmax memory traffic ~4x — stanfordnlp · 2026-10-21
- NVIDIA Cosmos3-H-Dreams: Generative Simulation Brings Clinical Surgery to Life — Hugging Face Blog · 2026-10-21