RTX 3090 dual-GPU local inference: 66K-token prefill at ~2,050 tok/s plus a crash fix
Atagor · reddit · 2026-11-17
A Reddit user benchmarked Qwen3.8-Flash-Next (Unsloth UD IQ4XS) locally on an RTX 3090 24GB + RTX 2080 SUPER 8GB with 96GB DDR4: 80.4 tok/s chat decode, 0.47s first token, 1,915 tok/s at 16K prompt processing, 101.7 tok/s agent decode with 69.4% cache hit. A custom 66,371-token needle test held 2,050 tok/s prefill (34s) and 76.1 tok/s decode with the mid-context passphrase correctly retrieved.
Key tip for 3090 owners: pinning the memory clock at 9501 MHz avoids a driver bug where dropping from full speed with near-full VRAM freezes the whole PC — trade-off is 110W idle instead of 25W, but memory-heavy workloads actually run faster. Sustained load temp: 79°C.
More from Infra
- Microsoft's USB4 RDMA lets mini PCs pool memory to run Qwen3-235B — JFPuget · 2026-11-22
- LTX 2.5 keeps crashing on AMD 9070 XT with driver timeouts while MiniMax H3 runs fine — ZestycloseReading504 · 2026-11-22
- FT: AI server suppliers raise prices up to 45% months after deals are signed — nordicinst · 2026-11-22
- China Installed 59% of New Industrial Robots in 2026 Report, ~354,000 Units — ingliguori · 2026-11-22
- MLX over Vulkan hits 124 tok/s on RTX 5060 Ti, beating llama.cpp CUDA by 25% — SumitGup · 2026-11-22
- Intruder swapped Prime Intellect's hosted DeepSeek for an abliterated copy for 53 hours — mawcopolow · 2026-11-22