Qwen Image 2.1 quantized to 2x speed — but INT4 quantization loses to FP4
mesmerlord · reddit · 2026-09-22
A developer quantized the new Qwen Image 2.1 to replicate their paid tool's serverless setup (previously Flux klein + nunchaku), publishing weights as Mesmer-Image-21-Nunchaku on Hugging Face.
Key findings:
- INT8 conversion ballooned to 9GB; INT4/FP4 come in around 4.8GB
- Roughly 2x faster, but with quality hits: text survives well, background faces degrade (especially at 40 steps — 25 steps fares better), and diagrams suffer noticeably
- Full comparison benchmarks (BF16, FP4 for RTX 50xx, INT4 for 40xx and below) at mesmer.tools/benchmarks/qwen-image-2-1
- Surprising result: INT4 is worse than FP4, so 50xx-card users should take the FP4 route
- Author notes anyone with a coding agent could reproduce the same conversion pipeline themselves
More from Infra
- Rackspace joins NVIDIA Cloud Partner Program with Blackwell pods for regulated enterprises — DavidLinthicum · 2026-09-22
- Bridging LLM Decision Readouts into DuckDB: Zero-Token Probabilistic Classification via LuaJIT UDFs — Shoddy_Telephone9702 · 2026-09-22
- Nvidia launches DSX Ready to certify AI factory power and cooling, Tesla and LG first in line — emmanuelvivier · 2026-09-22
- ContextBridge: an open-source pool that routes AI tasks across local machines, APIs and shared hosting — IamAngusU · 2026-09-22
- SENPAI Auto-Research Agent Writes Kernels, Cuts Training Time 22% (26h to 22h) — morgymcg · 2026-09-22
- Qwen3.8-27B hits >70 tok/s and full 262k context on 2x3090 with vanilla vLLM — maqifrnswa · 2026-09-22