DDR4 + 7900XTX Runs Qwen3-Next at 45-50 tok/s via Strata, Double llama.cpp Speed
EmPips · reddit · 2026-10-03
A Reddit user reports running Qwen3-Next with IQ3XXS weights (80GB) via Strata on slow DDR4 + a 7900XTX, hitting a stable 45-50 tok/s — roughly double llama.cpp's tuned 22.5 tok/s on the same rig. Similar results reported with 12/16GB cards, faster on DDR5; quality reportedly superior (avoid Q2 weights). If a 27B doesn't fit well, this is a viable alternative — and the author suggests asking an LLM to set it up for your specs.
More from Infra
- AMD Loom boosts Qwen3.5-4B prefill up to 2.6x on Radeon 890M laptops — jfowers_amd · 2026-11-19
- Dev submits PR adding periodic checkpoints to GKE sandboxes so agents don't lose progress — yoimnotkesku · 2026-11-19
- AWS Lambda Adds GPU Support via Managed Instances for Inference and Media Workloads — DavidWells · 2026-11-19
- Nvidia Allegedly Made GPUs Artificially Scarce to Keep Prices Sky-High — GaryMarcus · 2026-11-19
- AWS adds private CA support to Bedrock AgentCore Identity for connecting agents to self-hosted IdPs — AWS ML Blog · 2026-11-19
- Leak Hints at Classified 1M-GPU Training Cluster in China That Skips HBM — teortaxesTex · 2026-11-19