Qwen3.8 27B hits 140 t/s on AMD RX 7900 XTX with speculative decoding
Jebbyk1 · reddit · 2026-11-20
A Reddit user ran Qwen3.8 27B on an AMD RX 7900 XTX at 100-140 tokens/s using a llama.cpp fork tuned for the RDNA3 architecture with speculative decoding.
Per the llamaperf community report: Q4KM quantization, 192K context, 140.0 t/s generation and 862.3 t/s prefill — showing RDNA3 GPUs are now quite viable for local LLM inference.
More from Infra
- Quantum Computing Takes Aim at AI Workloads as IBM and QuEra Map Fault-Tolerant Roadmaps — mikeflache · 2026-11-20
- Tencent Earnings Call: Latest Chip Restrictions Will Accelerate China's Domestic Semiconductor Supply Chain — basedjensen · 2026-11-20
- Chorus paper: shared n-gram tables cut memory 87% while beating DeepSeek's Engram — brown2green · 2026-11-20
- px0: A 20MB browser-based IDE for AI-generated code, built by chopping layers with first-principles thinking — arpit_bhayani · 2026-11-20
- Tsinghua-spinoff Qingyi launches Ascend 950DT 10,000-GPU token factory, lifting utilization from 40% to 80% — 量子位 · 2026-11-20
- SenseNova-Loop 9B runs on 8GB VRAM at 22 t/s, uses half the tokens of Qwen3.8 — R_Duncan · 2026-11-20