Single Strix Halo Beats Six-GPU Rig Running 176B Qwen MoE at Long Context
fallingdowndizzyvr · reddit · 2026-10-01
A Reddit user benchmarked AMD's Strix Halo APU against a pile of consumer GPUs (2x RTX 5070 Ti, 2x RX 7900 XTX, 2x RTX 5060 Ti 16GB) running Qwen QFN (176B A3B MoE, Q4 quantization, 104GB).
The counterintuitive result: at 160K context, the single Strix Halo wins decisively:
- Six-GPU rig: PP 215.73 / TG 16.29 t/s
- Strix Halo (Gufo backend): PP 1227.12 / TG 22.04 t/s
- Strix Halo (Halo Box fork): PP 587.99 / TG 21.24 t/s
- Strix Halo (llama.cpp mainline 0.4.1): PP 113.48 / TG 7.06 t/s
The consumer GPUs lack VRAM, so pipeline parallelism and cross-card communication crush long-context throughput, while Strix Halo's unified memory shines. Backend choice also matters enormously: the Gufo-optimized build delivers 3x+ the TG speed of llama.cpp mainline.
More from Infra
- BIS issues rule blocking remote access to US AI chips via third-country data centers — teortaxesTex · 2026-11-16
- Qdrant 1.20.1: 50% fewer cold-storage reads, ~2x faster quantization, agent-ready setup — qdrant_engine · 2026-11-16
- One 16GB GPU runs songs, voice, images, 720p video and local RAG — all offline and open source — llama-of-death · 2026-11-16
- Starlink Now Protects Greek Trains From Collisions With 5cm-Accurate Tracking of 134 Locomotives — XFreeze · 2026-11-16
- Google donates Agent Substrate, gVisor and OpenRL to CNCF; Agent Substrate 1.0 goes GA on GKE — dl_weekly · 2026-11-16
- Nvidia scandal isn't slowing down: Huang's near-$100B power web under strain — The Verge AI · 2026-11-16