Tencent's DSpine speculative decoding ships GGUFs and a llama.cpp PR: 4.5x speedup on 27B

pmttyji · reddit · 2026-11-17

Tencent's DSpine speculative decoding (parallel drafting, depth conditioning) is now practical: Qwen3.8-27B DSpine b16 GGUFs are on Hugging Face with model cards comparing against DFlash2, and llama.cpp PR #31941 is open. On an RTX 3090 24GB: 125 tok/s on code/math (4.5x vs no speculation, 2x vs DFlash2), 90 tok/s on mixed chat (3.2x); max context 64k at 15 drafted, 98k at 7. Advantage holds at depth: 35.5 tok/s at 64k vs 19.5 without.

Original post →

More from Infra

Infra channel →