Qwen3.8-Flash on 4x AMD V620 hits 1,300 PP and 70+ tok/s on coding
Thin_Pollution8843 · reddit · 2026-09-17
A Reddit user benchmarked the quantized Qwen3.8-Flash-Next (W4A16-AutoRound, roughly between q5-xl and q6-xl quality) on 4 RDNA2 AMD V620 GPUs via the community vllm-rdna project: 1,300-1,393 tok/s prompt processing and 56-59 tok/s generation at 32K-128K contexts, rising to 68-72.5 tok/s on coding suites. A budget path to local inference on aging datacenter GPUs.
More from Infra
- Palmer Luckey asks: can you use datacenter RAM for things prohibited by the operator's terms of service? — avaitopiper · 2026-11-02
- Disable MTP for 20-30% faster local LLM inference on limited RAM — InternalMode8159 · 2026-11-02
- Kioxia up 216% in a year but down 68% from its June 2026 peak — zephyr_z9 · 2026-11-02
- Intel plunges 29%, worst day since the 1970s, wiping $12B off US government stake — emmanuelvivier · 2026-11-02
- Researcher hoards nearly 1TB of DRAM, refuses to sell a stick to data centers — kevinnbass · 2026-11-02
- Self-Hosting LLMs at a Law Firm: Infra and Data Governance Harder Than the Model — EducationalGroup7245 · 2026-11-02