DNeo diffusion drafter speeds up LLM inference by up to 30%
Scobleizer · x · 2026-11-20
NeuralArchitect, in collaboration with Cerebras researchers, introduced DNeo, a new diffusion drafter that makes LLM inference up to 30% faster. The key insight: draft models need working memory and the right context encoding mechanism. Paper available.
Related event: DNeo Diffusion Drafter Speeds Up LLM Inference by Up to 30%(2 posts)→
More from Infra
- 2M canary tokens reveal 3 breached AI providers and resellers stealing prompts — dyn___ · 2026-11-20
- Nvidia's China revenue is higher than 9% once smuggling and remote access count — zephyr_z9 · 2026-11-20
- Can same-family models share warm cache? Reddit debates mid-conversation model switching costs — rapPayne · 2026-11-20
- Anthropic IPO jumps 32% to ~$110/share as AMD sinks on China server maker report — kimmonismus · 2026-11-20
- DeepMind projects at least 10x annual growth in effective compute and steeply cheaper cognitive work — dfinke · 2026-11-20
- Open-source Intern harness: Opus 5.5 hands off to Hy4 Flash, 92.4% at 1/3 the cost — m4rkGS · 2026-11-20