DFlash2 drafter boosts Qwen3.8-Flash-Next local decode 17% with a tiny 350MB head
returnity · reddit · 2026-10-31
Testing DFlash2 for Qwen3.8-Flash-Next on llama.cpp v0.8.0 (M5 Max), a user measured +17% average decode speed vs MTP (75.1 → 87.9 tps geometric mean), with +39% on lists and only -3% on prose. Recommended settings: n-max=5, p-min=0.75 for DFlash2. The Q40 draft head is just 350MB (vs 2.2GB for MTP) with no measurable quality penalty, vision prompts now work, and gains flatten at 25K context. GGUFs are released — a free upgrade for local inference users.
More from Infra
- Dev publishes FLARE-based Qwen 3.8 Flash Next images with 1M context for RTX 6000 PRO — johannes_bertens · 2026-10-31
- AI spending spree deepens free cash flow holes; Microsoft stays positive via $25B bond offering — Kr00ney · 2026-10-31
- Google Cloud spend caps go GA with API, live cost reports and automatic monthly resets — rseroter · 2026-10-31
- Swift 1.5 Flash Next Heretic quants add IQ4_XS and IQ3_S tuned for reverse engineering — jjusko20 · 2026-10-31
- ClickHouse discloses unauthenticated RCE vulnerability CVE-2026-116366, patches available — Hacubu · 2026-10-31
- Count document passes, not tokens: batching questions cuts LLM scoring cost — petrusenko_max · 2026-10-31