Dev runs Qwen-Image 2.1 fully on a 12 GB RTX 3060, loses honest 20-prompt bake-off to gpt-image-2
Sg1000deping · reddit · 2026-09-24
A developer released a free Windows desktop app and CLI (qil, MIT-licensed) that runs Qwen-Image 2.1 entirely in VRAM on a 12 GB card (RTX 3060), generating 1024² images in 35 seconds.
How it fits in 12 GB: the text encoder (8.9 GB), DiT (6.9 GB) and VAE (0.6 GB) can't coexist in VRAM, so each stage is loaded wholesale when it runs while others wait in RAM, using Comfy-Org's int8 "convrot" weights. One gotcha: CUDA 12.8 PyTorch builds silently disable ComfyUI's optimized CUDA backend — cu130 fixes it.
Measured: 32–35 s at 1024²/20 steps, 11.4 GB peak VRAM, 7 min for native 2K at 40 steps.
Honest 20-prompt comparison vs gpt-image-2 (no cherry-picking): Qwen 1 win, 8 ties, GPT 11 wins. Editing is on par (7 ties + 1 win in 8 tasks), but GPT clearly leads at text-to-image — Qwen follows long prompts less closely, garbles small text, and has weaker world knowledge. All prompts, images and verdicts are published; the repo builds with one command.
More from Infra
- Podcast: Pathway's 150M-Parameter BDH Model Aims Beyond Transformers — bigdata · 2026-09-24
- stable-diffusion.cpp runs SD, Flux, Wan and Z-Image diffusion models in pure C/C++ — leejet · 2026-09-24
- NVIDIA's Model-Optimizer unifies quantization, distillation, pruning and speculative decoding — NVIDIA · 2026-09-24
- How much memory for a 30B model? A quick precision-to-VRAM calculation — ashishllm · 2026-09-24
- Starship Flight 14 stack in place, first 26 operational V3 Starlink satellites loaded — DimaZeniuk · 2026-09-24
- Newest ESP32 can run Linux and is closing in on the Raspberry Pi — adunk · 2026-09-24