From 9 to 48 tokens/s: STRATA + CachyOS supercharges local Qwen Flash on an 8GB GPU
Ne00n · reddit · 2026-10-21
A Reddit user reports local inference on a 4060 8GB + 64GB DDR4 rig jumping from 9 tok/s (Unsloth 3-bit via llama.cpp) to peaks of 48 tok/s (avg 30) after switching to STRATA on CachyOS, which handles NVIDIA drivers out of the box. VRAM limits context to 42k tokens (32k comfortable), just 130MB short of OOM. They call the model "like Claude but locally."
More from Infra
- PyTorch once anchored NVIDIA's CUDA moat — the moat keeps changing — ivan_bezdomny · 2026-10-21
- ai& claims to be Japan's biggest dedicated inference platform with 100MW+ data centers — DavidBennett__ · 2026-10-21
- SpaceX Reportedly Adding 10GW of Compute by 2027, Up from 1.7GW Today — beffjezos · 2026-10-21
- Musk's Hunt for Rentable GPU Compute Turns Into a Real-Life Cheese Shop Sketch — XFreeze · 2026-10-21
- Cloudflare discloses compromised eMudhra intermediate certificates, urges patching — Cloudflare Blog · 2026-10-21
- Shotwell: Starlink now contracted for ~12,000 planes, a quarter of available aircraft — XFreeze · 2026-10-21