Benchmarks show ComfyUI in Docker (CUDA 12.4) runs at 0% penalty if you fix the /dev/shm OOM crash
fluxdraw · reddit · 2026-09-13
A detailed benchmark comparing ComfyUI in Docker (Nvidia Container Toolkit, CUDA 12.4) vs bare-metal Ubuntu 24.04 across FLUX.1-dev, SDXL, and SD 1.5 found zero compute overhead and identical VRAM footprint (14.2 GB for FLUX.1 FP8). The catch: Docker's default 64MB /dev/shm causes OOM crashes with multithreaded dataloading — fixed with --shm-size=8g (or shmsize in compose). Full guide and production Dockerfile included.
More from Infra
- Community ports experimental DeepSeek V4.1 steering into antirez's C-based ds4 CLI — antirez · 2026-09-13
- Threadripper 3975WX + 4070 Ti Super gets only 10 tok/s on Qwen 27B Q5 — tuning help wanted — ifjo · 2026-09-13
- MHA, MQA, GQA and MLA explained by what happens to the K/V cache during decoding — techNmak · 2026-09-13
- Early OpenAI employee says 'winning' AGI is outdated — 99% of future compute will run locally — GregCook2011 · 2026-09-13
- Qwen3.8-27B EXL3 one-click kit brings quality local LLM to 16-32GB consumer GPUs — udmrzn · 2026-09-13
- Nex-N2.5-mini-MLX-4bit hits 133.6 tok/s on Apple M5 Max — DerTomsn · 2026-09-13