ComfyUI: forcing full GPU offload for the diffusion model only
Rare_Subject2343 · reddit · 2026-11-06
A Reddit求助: on a 16GB AMD 7600xt (Fedora 45, ROCm 10.3.0), the int8 diffusion model fits in VRAM but the int8 Qwen3.5 9B text encoder doesn't. KSampler speeds still look CPU-offloaded (2 min for 50 steps), and --gpu-only crashes the OS by loading everything onto the GPU. The poster asks how to force full GPU residency for the diffusion model while partially offloading the text encoder.
More from Infra
- Veteran investor: memory stocks aren't cheap even at P/E of 3 as LTAs are meaningless — bookwormengr · 2026-11-06
- Enterprise AI's future is local: tactical workloads favor Dell, HPE, Lenovo, Supermicro over frontier labs — DavidLinthicum · 2026-11-06
- Texas Governor-Elect: Approved Data Centers Can Be Completed, New Projects to Pay Taxes — GavinSBaker · 2026-11-06
- Marin's open 535B-A23B MoE finishes main pretraining on 18T tokens, checkpoints soon — dlwh · 2026-11-06
- Buoyant Open-Sources Kinference, an Inference Control Plane for vLLM on Kubernetes — vllm_project · 2026-11-06
- vLLM ranks #2 most-engaged open-source repo in GitHub Octoverse, #8 by contributor growth — vllm_project · 2026-11-06