Running Qwen3.8-27B on a 12GB RTX 3060 with 65K context: full recipe inside
WiseVanilla2743 · reddit · 2026-11-15
A seasoned r/LocalLLaMA user runs ISTA-DASLab's Qwen3.8-27B-GSQ-RCO GGUF (IQ3XXS quant, non-MTP, turboquant) on an RTX 3060 12GB with only 16GB DDR4, offloading mmproj to system RAM while keeping the full 65K context on GPU. They report completing agent tasks that need real reasoning fully on-device, and share the complete llama-tq serve command (reasoning-budget 256, -ngl 99, -c 65536, etc.), asking the community for feedback.
More from Infra
- Pruned-vocab Qwen3.8-27B fits 75K context on 16GB at ~60 tok/s, IFEval unchanged — fakezeta · 2026-11-15
- Cisco hits $9B AI revenue, beats and raises, yet shares fall 6% anyway — pdamodaran · 2026-11-15
- AWS investigates connectivity issues affecting multiple services in us-east-1 — kingslyj · 2026-11-15
- RustingStrata 1.2.3 ships a built-in local chat page in a single Rust binary — Serious_Scarcity7818 · 2026-11-15
- Congress reportedly prepping tighter AI chip export controls with bipartisan support — Polymarket · 2026-11-15
- ggml tensor library trends on GitHub with 15.8k stars, up 154 in a day — ggml-org · 2026-11-15