Open-Sourced DSpark Speculator Boosts Inkling Throughput by 1.89x

Developers have open-sourced a new DSpark speculator for the Inkling NVFP4 model, built using SpecForge on an online SGLang engine. This speculative decoding implementation successfully boosts decoding throughput by 1.89 times.

2026-07-23 ~ 2026-07-23 · 3 related posts