Running vLLM on mixed NVIDIA 50+40 GPUs: a DIY resource config repo
Fz1zz · reddit · 2026-10-01
Reddit user Fz1zz tried pushing their PC with two NVIDIA GPUs (a 50-series and a 40-series) running vLLM, found official support for this heterogeneous combo lacking, and published their own resource configuration at GitHub repo ExTV/dual-gpus-vllm to help others with similar setups.
More from Infra
- turbopuffer rewrites storage engine v3 in public, grinding query plans live — vboykis · 2026-10-01
- BofA Raises Micron Targets on Durable AI Memory Cycle, Sees $60-100B Buyback by FY28-29 — firstadopter · 2026-10-01
- Distilled 260M text-to-image model hits <190ms on a T4, generating per keystroke — Gradio · 2026-10-01
- Agent spins up 322 Hugging Face Jobs in 90 minutes to test code, total bill ~$4 — vanstriendaniel · 2026-10-01
- Anthropic reportedly buying ~5GW of compute from Broadcom, may become its largest customer by 2027 — zephyr_z9 · 2026-10-01
- Supertonic: open-source 99M-param local TTS beats ElevenLabs in tests — JafarNajafov · 2026-10-01