10-minute load times on RTX 6000? Dev troubleshooting ComfyUI bottlenecks
buttplugs4life4me · reddit · 2026-08-04
A DevOps engineer reported severe performance bottlenecks when running ComfyUI with an NVMe SSD and an RTX Pro 6000 GPU, experiencing loading times of over 10 minutes per generation.
Investigation revealed that ComfyUI appears to load the entire model into system RAM before transferring it to VRAM. During this process, neither the CPU, storage, RAM, nor GPU are fully utilized. In contrast, loading a similarly sized (32GB) LLM using vLLM or llama.cpp takes only 30 seconds to 2 minutes.
The author complained about ComfyUI's overly complex deployment experience, citing numerous CLI arguments that don't always work together and a lack of useful debug logging, making it one of the hardest projects they've ever deployed.
More from Infra
- Open-Source 'Personal AI Computer': Build a Local AI Data Center with RTX 5090s — dee_hw · 2026-08-05
- AI Compute Demand to Quadruple Data Center Electricity by 2030 — bittingthembits · 2026-08-05
- DeepSeek V4 Flash Local Deployment Hits 16k Output Limit — El_90 · 2026-08-05
- China's Potential InP Wafer Export Ban Threatens Global AI Infrastructure — teortaxesTex · 2026-08-05
- 3-Hour Deep Dive with vLLM Core Dev: Open Source Infra and Model Co-design — vista8 · 2026-08-05
- Running MiniMax H3 on a Single 3090: Troubleshooting OOMs and Optimizing Args — knoll_gallagher · 2026-08-05