RTX 3090 dual-GPU local inference: 66K-token prefill at ~2,050 tok/s plus a crash fix

Atagor · reddit · 2026-11-17

A Reddit user benchmarked Qwen3.8-Flash-Next (Unsloth UD IQ4XS) locally on an RTX 3090 24GB + RTX 2080 SUPER 8GB with 96GB DDR4: 80.4 tok/s chat decode, 0.47s first token, 1,915 tok/s at 16K prompt processing, 101.7 tok/s agent decode with 69.4% cache hit. A custom 66,371-token needle test held 2,050 tok/s prefill (34s) and 76.1 tok/s decode with the mid-context passphrase correctly retrieved.

Key tip for 3090 owners: pinning the memory clock at 9501 MHz avoids a driver bug where dropping from full speed with near-full VRAM freezes the whole PC — trade-off is 110W idle instead of 25W, but memory-heavy workloads actually run faster. Sustained load temp: 79°C.

Original post →

More from Infra

Infra channel →