Qwen 3.5 9B + DFlash hits 75 tok/s on R9700: Full Setup Guide
karmakaze1 · reddit · 2026-08-20
A Reddit user shared a detailed guide to achieving 75 tokens/sec inference speed with the Qwen 3.5 9B model on an R9 7900 GPU. The setup combines a fine-tuned model (DavidAU/Qwen3.5-9B-The-Defiant-Fable...) with DFlash draft model acceleration, utilizing Q80 quantization and 64K context.
Key steps include:
- Tokenizer Prep: Downloading official Qwen BPE files to the DFlash source directory.
- Conversion: Converting the draft model to GGUF format using converthftogguf.py.
- Config: Updating the INI file to use model-draft and spec-draft-n-max for Speculative Decoding.
- Execution: Providing a CLI command to launch the server.
This approach leverages a draft model to significantly boost generation throughput.
More from coding & agent
- Short Film FARÖ Behind the Scenes: Using Invideo Agent for Production — gen_ericai · 2026-08-20
- Developer rebuilds classic iBeer app using React Native and WebGPU physics — JoshuaJBouw · 2026-08-20
- Together AI Releases Hallmark: An Anti-Slop Design Skill for AI Coding Tools — dotey · 2026-08-20
- Google Engineer Breaks Down Agents: LLMs in a Loop and the Reality Gap — bigdata · 2026-08-20
- 12 browser tasks automated with OpenAI: from bookkeeping to form filling — gdb · 2026-08-20
- Deep Dive: Instinct, Grok Bots, and ChatGPT Work Compared — illscience · 2026-08-20