Discussion: Can 128GB RAM + 16GB VRAM Run Qwen 3.5 122B?
Stock-Union6934 · reddit · 2026-07-06
A user asked in the community about the performance of running Qwen 3.5 122B (MoE architecture) on a setup with 128GB DDR5 RAM and 16GB VRAM, seeking feedback from those with practical experience. This involves hardware configuration selection and feasibility for local deployment of large models.
More from Infra
- Encrypted GPT-2 speedrun challenges FHE inference: best is 3.031 s/token, goal sub-1s — tensorqt · 2026-10-27
- Open-source Latch compiles PyTorch into training megakernels, 2.75x faster on H100 — sguada · 2026-10-27
- NVIDIA claims HGX Rubin NVL8 delivers 10x tokens per megawatt vs B200 — thursdai_pod · 2026-10-27
- NVIDIA Claims HGX Rubin NVL8 Delivers 10x More Tokens per Megawatt Than B200 — thursdai_pod · 2026-10-27
- Together lets multiple LoRA post-training experiments share the same GPU capacity — togethercompute · 2026-10-27
- Commoditization dilemma: either human labor or GPUs become the commodity — _AustinCalvert_ · 2026-10-27