Local LLM setup: Strata lets a 7900XTX + 64GB RAM run Qwen Flash at 60 tok/s at 250K context
soyalemujica · reddit · 2026-10-03
A Reddit user reports running Qwen Flash via Strata on a 7900XTX (24GB VRAM) + 64GB DDR5 setup, hitting 60 tokens per second even at 250K context and q8 precision.
They claim it outperforms the dense 27B model they dropped — better instruction following, more reliable planning, and capable of running frontend/backend test loops — while eliminating OOM errors and freeing the PC for gaming.
Notable details: a 6GB VRAM reserve keeps Windows 11 usable, and Windows performance now matches Linux. A practical data point for local MoE deployments.
More from Infra
- AMD Loom boosts Qwen3.5-4B prefill up to 2.6x on Radeon 890M laptops — jfowers_amd · 2026-11-19
- Dev submits PR adding periodic checkpoints to GKE sandboxes so agents don't lose progress — yoimnotkesku · 2026-11-19
- AWS Lambda Adds GPU Support via Managed Instances for Inference and Media Workloads — DavidWells · 2026-11-19
- Nvidia Allegedly Made GPUs Artificially Scarce to Keep Prices Sky-High — GaryMarcus · 2026-11-19
- AWS adds private CA support to Bedrock AgentCore Identity for connecting agents to self-hosted IdPs — AWS ML Blog · 2026-11-19
- Leak Hints at Classified 1M-GPU Training Cluster in China That Skips HBM — teortaxesTex · 2026-11-19