NVIDIA Releases Draft Model to Accelerate Speculative Decoding

NVIDIA released a 4B-parameter Qwen3.5-4B draft model on Hugging Face for Qwen3.8-27B speculative decoding, boosting token acceptance by 46% over the model's built-in drafting.

2026-11-18 ~ 2026-11-19 · 2 related posts