Doubling to 4× RTX 5060 Ti 16GB for local MoE inference: is it worth it?

Pear_Virtual · reddit · 2026-11-16

A local LLM build discussion: with 2× RTX 5060 Ti 16GB running Qwen3.8 Flash next IQ3S on the basalt engine at 70+ tok/s decode and 900 tok/s prefill, the poster weighs buying two more cards so all experts fit in VRAM, targeting 150+ tok/s. Setup is 64GB DDR4 on X570 with PCIe bifurcation options (8x+8x or 4x4x4x4); dual 3090s at similar price are also on the table, while 128GB DDR4 is ruled out by local overpricing.

Original post →

More from Infra

Infra channel →