Titan RTX + 3090 without NVLink: is multi-GPU inference via Strata worth it?
Express_Quail_1493 · reddit · 2026-10-15
A Reddit user asks: with an asymmetric pair of 24GB cards (Titan RTX + RTX 3090, no NVLink) and 48GB spare system RAM, they currently run Qwen3.8-27B at 300K context at 32 tok/s on the single 3090 while the Titan RTX sits idle. They wonder whether multi-GPU inference with Strata is worth it and whether it would massively hurt prefill speed, asking for real-world test results.
More from Infra
- patio11 on multi-agent dev: clearly the future, and we'll buy so much inference — IgorCarron · 2026-10-15
- Hugging Face Hub makes model tensor inspection up to 20x faster, DeepSeek-V3.2 drops from 9.2s to 0.45s — victormustar · 2026-10-15
- RTX 5060 Ti 16GB surges up to 144% in Japan, hitting $1,292 as RTX 5080 tops $2,400 — chemist_slime · 2026-10-15
- Fish Audio Drama 3 lands in vLLM-Omni: 128 concurrent streams on one H200 — vllm_project · 2026-10-15
- 1,174 Macs form Darkbloom inference network, growing 4.5x in 60 days at half the cost — gajesh · 2026-10-15
- ByteDance in advanced talks with MediaTek for custom AI data-center chips, Bloomberg reports — mark_k · 2026-10-15