Dual RTX 3090 running Qwen3.8-27B locally at 50-65 tok/s — is that normal?
sugarfreecaffeine · reddit · 2026-08-20
A Reddit user shares their setup running Qwen3.8-27B (unsloth dynamic Q6KXL quant) locally with llama.cpp on Windows 10, dual RTX 3090 (48GB VRAM), for local agentic coding. They see 50-65 tokens/sec generation, sometimes dipping to the 40s, and ask if that's expected. The full llama-server command is included — 262K context, q80 KV cache, flash attention, MTP speculative decoding — a useful reference for local deployment tuning.
More from coding & agent
- Decision models match LLMs on routing and safety — and are 7-8x faster — randal_olson · 2026-10-16
- Temporal Serverless Workers on Cloud Run: queue-driven autoscaling, scale to zero — rseroter · 2026-10-16
- Meta's Superintelligence Lab Runs 200+ Direct Reports—A Lesson for Flat Multi-Agent Systems — peterjliu · 2026-10-16
- LangChain CEO: the most interesting agent harness work lives at the harness-infra boundary — hwchase17 · 2026-10-16
- GitSwarm paper: agents share branchable Git memory, solving all 30 IMOProofBench problems in one run — anirudhg9119 · 2026-10-16
- Hands-on with Gemini 4 Argon: faster than Opus 5.5 but hallucinates more and costs more — prasenx · 2026-10-16