Migrating from LM Studio to vLLM: RTX 3090 performance doubled
Bpthewise · reddit · 2026-08-22
The author shares their experience migrating from LM Studio to vLLM, utilizing configurations from Syv-ai's repository.
Key points:
- Hardware Usage: Running separate endpoints on two RTX 3090s, one for chat and one for sub-agents.
- Performance Gain: Qwen3.8 inference speed significantly increased to 143 tok/s, making the reasoning process much smoother.
- Thermal Improvement: Water-cooled GPUs stay at just 35°C under heavy load, compared to hitting 70°C with LM Studio.
- Conclusion: vLLM feels like fully utilizing the hardware's potential.
More from Infra
- Nvidia's developer base hits 11 million, up ~3.7x from 3 million in 2021 — Beth_Kindig · 2026-10-16
- Muse Spark Open runs locally on a Mac M3 Ultra via llama.cpp: frontier model on desktop — pcuenq · 2026-10-16
- Muse-Spark open-weights drop: 816B-A42B MoE model gets 359GB MLX 3-bit build — ns123abc · 2026-10-16
- Meta launches Muse Spark Open, says it runs on two M5 Ultra Mac Studios with Apple's help — The Verge AI · 2026-10-16
- vLLM ships Day-0 LoRA RL for Muse Spark Open, lifting AIME from 0.56 to 0.85 — vllm_project · 2026-10-16
- DSpark draft model for Muse Spark Open proposes 7 tokens per pass with 23-42% acceptance — vllm_project · 2026-10-16