Dual RTX 3060 Local LLM Setup: 100k Context at 600 tok/s, $2k Upgrade Paths
gnoremepls · reddit · 2026-09-19
A Reddit user shares real numbers from a dual second-hand RTX 3060 (2×12GB, $300 each) setup running Qwen3.8:27B: 100k context at Q4, 600 tok/s input and 45 tok/s output, plus idle 128GB DDR5-5600. With a $2k budget they weigh adding two more 3060s in a 4-GPU machine (PCIe lane bottleneck concerns), a single RTX 3090 ($2000 for only +8GB), or dual 24GB Intel B60 cards ($800 each), with community advice on offloading and scaling.
More from Infra
- Malaysia poised to become a compute superpower with both US and Chinese chips by next year — basedjensen · 2026-11-04
- ByteDance details USDB storage system: 85.8% lower write latency for recommender sequences — _reachsumit · 2026-11-04
- Oracle cancels $7B chip leasing deal with Tencent, FT reports — SumitGup · 2026-11-04
- Inference engine shrunk to 1023 bytes, still runs SmolLM2-135M — cneuralnetwork · 2026-11-04
- Musk says space data centers are 'looking pretty appealing right now' — elonmusk · 2026-11-04
- Data centers are turning to old jet engines as the wait for power grows — IndependentCoast3974 · 2026-11-04