On DGX Spark, bf16 beats int8 convrot: H3 video gen 272s vs 287s in real tests
dtdisapointingresult · reddit · 2026-09-29
A Reddit user benchmarked ComfyUI's int8 convrot quantized models on DGX Spark expecting 40-50% speedups. Results overturned expectations: Z-Image-Turbo int8 (6.3GB) ran 6.60s vs bf16 (13GB) 7.63s, with nvfp4 fastest at 5.37s — but for H3 5-second video, bf16 (40.2GB) finished in 272.22s, actually beating int8 convrot (21GB) at 286.66s. Dequantization overhead can erase or reverse quantization gains; benchmark on your own hardware before upgrading. Launch flags: --use-ck-attention --disable-mmap --cache-classic.
More from Infra
- Mobile AI Factory: agents auto-build on-device SLMs with 19x less GPU time — pmttyji · 2026-11-16
- Stratechery's Fictional Obituary: Imagining Jensen Huang's 2026 Exit From Nvidia — Gregory_C_Allen · 2026-11-16
- vLLM serves DeepSeek V4.1-Flash at 954K tokens/s per GPU, $38.96/GPU-hour on GB300 NVL72 — bookwormengr · 2026-11-16
- Colossus 2's 1.2M B200s could generate ~$400B/year in tokens at DeepSeek Flash rates — bookwormengr · 2026-11-16
- BIS issues rule blocking remote access to US AI chips via third-country data centers — teortaxesTex · 2026-11-16
- Qdrant 1.20.1: 50% fewer cold-storage reads, ~2x faster quantization, agent-ready setup — qdrant_engine · 2026-11-16