Benchmark: Qwen 3.8 hits 45 tps with 1M context on 3080Ti + Strix Halo
TrifleHopeful5418 · reddit · 2026-08-18
The author shared performance data for running Qwen 3.8 on an AMD Strix Halo (128GB) + eGPU 3080Ti (12GB) setup:
- 262K Context (Q6): iGPU only 10 tps; with MTP (n=4) 24 tps; with FastMTP offloaded to 3080Ti 28 tps.
- 262K Context (Q4km): Layer splitting (weights + FastMTP on 3080Ti) 53 tps.
- 1M Context (Q4km): Layer splitting 45 tps.
While slower than a 5090 setup, there is ample memory remaining to load Embedding and Reranker models simultaneously. The author plans to compare this against Qwen 3.6-35B running on 4x3090 (450 tps).
More from Infra
- Prediction: Opus 5.5-level models on laptops by 2027, backed by Qwen 27B data — cephaloform · 2026-10-16
- Oracle down 12% in a week, nearly 50% off June high as OpenAI exposure spooks market — alvelda · 2026-10-16
- US data center moratoriums top 400 — an AI bull explains why they're actually good for AI — kevinsxu · 2026-10-16
- Microsoft Research unveils Magnetar, the fastest zkVM at 10-39x speedups and post-quantum security — jedisct1 · 2026-10-16
- Bonsai 2 2B hits 120 tok/s on iPhone 18 Pro, outpaces Qwen 3.5 2B at half the memory — cephaloform · 2026-10-16
- Samsung cuts Q4 phone output as Nittobo shifts E-glass to AI-chip T-glass — zephyr_z9 · 2026-10-16