Flux 3 Klein benchmark: nvfp4 hits 13.7s per image vs 25.2s for fp8
dh7net · reddit · 2026-10-17
A 192-prompt benchmark of Flux 3 Klein across precisions (fixed seed, 16 steps, no CFG, on gx10 hardware):
- NVFP4: 13.7 s/image (range 13.5–14.7)
- BF16: 19.7 s/image (19.4–20.9)
- FP8: 25.2 s/image (25.0–26.7)
nvfp4 is 84% faster than fp8 and even 30% faster than bf16. Full galleries of all 3×192 images are public for quality comparison.
More from Infra
- vLLM makers Inferact partner with AMD to optimize agentic inference on Instinct GPUs — woosuk_k · 2026-10-17
- Right-sizing context windows: Gemma 4 26B voice app fits on a single H100 — Ctbhatia · 2026-10-17
- PyTorch now runs natively on AWS Trainium with zero code changes — PyTorch · 2026-10-17
- Zuck bets most inference runs locally: Meta emerging as the champion of frontier local AI — StefanoGogioso · 2026-10-17
- ModelSphere launches as open-source LLM serving platform for mixed GPU fleets — Codeblix_Ltd · 2026-10-17
- .NET 10 Lambda ARM64 base image ships with 170MB of leftover Yum cache — DanielLockyer · 2026-10-17