Software magic: 4x V100s match RTX 5090 running Qwen 3.8 NVFP4
Simple_Library_2700 · reddit · 2026-08-19
A developer achieved performance parity between four Tesla V100s (2017) and an RTX 5090 when running Qwen 3.8 NVFP4 by writing a custom QPN kernel. Although V100s lack native FP4/FP8 support, the kernel translates fragments on the fly to FP16 for Volta's Tensor Cores. In single-request decoding, the V100 setup reached 219.1 tok/s, slightly edging out the 5090's 214.7 tok/s by verifying more tokens per round (5.89 vs 4.27).
More from Infra
- Musk says he wants 'maybe more than 10GW' of compute; Nvidia now counts SpaceX as a CSP and co-designs a space server — elonmusk · 2026-10-16
- Jensen Huang: Musk's AI buildout moved from K's to M's, now a CSP-tier NVIDIA customer — elonmusk · 2026-10-16
- EpochAI pegs GPT-6 training at up to 1.8e27 FLOP; scaling01 calls param estimates way too high — scaling01 · 2026-10-16
- Meta's Muse Spark Open scores 39 vs 48 for closed Spark 1.3 on AA Intelligence Index — EAccelerate_42 · 2026-10-16
- LLM spots useless 95GB-per-frame memcpy in ffmpeg dblur, cutting runtime from 2452ms to 49ms — IgorCarron · 2026-10-16
- DeepSeek-V4-Flash on 4x Radeon AI PRO R9700: the 'refused' 4-card config hits ~79 tok/s — brainchillzZ · 2026-10-16