The curse of 64GB RAM: Strata pushes local Qwen3.8-Flash-Next to 60 t/s but hogs system memory
Cautious_Chicken_604 · reddit · 2026-10-04
A local LLM enthusiast with an R9700 + RTX 5060 Ti + 64GB DDR5 shares a tradeoff story: the R9700 runs Qwen3.8-27B Q6 as a daily driver (35 t/s) while the 5060 Ti handles ComfyUI image/video inference.
- Running Qwen3.8-Flash-Next's 93GB IQ4XS quant on both cards via Vulkan only hit 15 t/s — unusable.
- With Strata running the 70GB IQ3XXS quant, llama.cpp on system RAM + R9700 hit 21 t/s; Strata reached 60 t/s, finally daily-drivable.
- The catch: QFN loaded in Strata pushes system RAM to 96%, making memory-hungry ComfyUI workloads like Minimax H3 impossible to run simultaneously.
The author is torn between finally running the big model and losing his media-generation workflow, with a 128GB RAM upgrade out of budget for now.
More from Infra
- DeepMind researcher: global AI compute growing at least 10x per year — 141_1337 · 2026-11-20
- GPU shortage debate: companies with real AI demand are still massively compute starved — matt_slotnick · 2026-11-20
- Microsoft's Bing Web IQ Goes GA on Azure: Auto Orchestration Delivers Fresh Grounding for Agents — dejanseo · 2026-11-20
- exe.dev ships Rex integration, making remote VMs the default agentic dev workstation — davidcrawshaw · 2026-11-20
- Ex-Waymo exec Abe Murray: CUDA and ISAs won't stay moats, huge chip innovation incoming — IgorCarron · 2026-11-20
- MIT and NVIDIA's QDA uses agents to auto-design LLM quantization recipes, beating top public ones by up to 2.2 points — omarsar0 · 2026-11-20