DFlash 2 Introduces Block-Diffusion Speculative Decoding to Speed Up GLM-5.3-Flash
songhan_mit · x · 2026-08-28
Inco AI released the DFlash 2 draft model, utilizing block-diffusion technology for speculative decoding to accelerate the inference speed of zai-org/GLM-5.3-Flash.
- Technical Mechanism: DFlash 2 is not a standalone language model; it operates within a speculative decoding server. It predicts an entire block of tokens in a single pass and employs two-tap dynamic convolutions to maintain draft quality, ensuring lossless decoding (greedy output matches the target model exactly).
- Deployment: It requires SGLang for serving, configured by setting speculative-algorithm to DFLASH.
- Performance: Benchmarks on GB300 GPUs indicate significant throughput improvements while adhering to the model's recommended sampling parameters (temperature 1.0, top-p 0.95), especially under high concurrency.
Related event: Inco AI Releases DFlash 2 Draft Model, Speeding Up GLM-5.3-Flash by 2.8x(3 posts)→
More from Infra
- How Microsoft optimized Windows for Nvidia's Arm-based RTX Spark AI laptops — tomwarren · 2026-10-15
- How Microsoft optimized Windows for Nvidia's Arm-based RTX Spark laptops — The Verge AI · 2026-10-15
- Global smartphone shipments plunge 22% in worst quarterly decline on record as AI demand fuels memory costs — Polymarket · 2026-10-15
- SK Hynix drops 11% again, now below 3x FY2027 earnings as AI memory selloff deepens — JOBhakdi · 2026-10-15
- ASML Sells Zero Lithography Machines into Europe as US Hosts 75%+ of AI Compute — NinaDSchick · 2026-10-15
- Nvidia quietly reclassified SPCX as 'Hyperscale', signaling deeper neocloud reliance — RihardJarc · 2026-10-15