Qwen3.8-27B achieves 2x decode speedup with DFlash2 on 256k context
maddie-lovelace · reddit · 2026-08-21
Tests on Qwen3.8-27B-UD-Q4KXL with DFlash2 on a single RTX 5090 show roughly 2x decode speedup (40 to 75 tps) at 256k context with only a 15% prefill slowdown. The post includes specific reproduction commands and configuration notes.
More from coding & agent
- Inflight launches: a feedback layer that turns prototype comments into Claude tasks — soleio · 2026-10-16
- Apple code signing drags for hours; official advice: just wait a week — pjausovec · 2026-10-16
- Hermes: a 4B model with 8K context got worse with more test-time compute, pointing to contextual reasoning — mangahomanga · 2026-10-16
- Flux 3 Klein's Default Templates Are Broken Without Its Prompt Upscaler — StrictMove5839 · 2026-10-16
- 21-person team ships hundreds of PRs weekly with AI writing 97% of the code — rseroter · 2026-10-16
- ClosedMCP: Set Up MCP Servers Once, Share Them Across Your Whole Team — Ok_Sprinkles1301 · 2026-10-16