NVIDIA Benchmarks NVFP4 vs BF16 on Nemotron 3.5 Lightning, Reproducible on One H100
NVIDIA Developer · youtube · 2026-09-15
NVIDIA Developer compares NVFP4 and BF16 in practice using Nemotron 3.5 Lightning, which ships as both BF16 and NVFP4 checkpoints. The walkthrough covers memory footprint, throughput, and accuracy, showing the smaller NVFP4 checkpoint frees GPU memory with little quality loss, and includes a notebook to reproduce the full comparison on a single H100.
More from Infra
- Your AI agent would cost 260% more without prompt caching, Arena data shows — arena · 2026-10-30
- Nebius runs auction-driven GPU pricing, lifting rates ~20% amid tight supply to 2028 — BenBajarin · 2026-10-30
- macOS update silently re-adds eMudhra root certs users had removed — steipete · 2026-10-30
- Bittensor's Terza Inference routes one API across miners' models on subnet 103 — const_reborn · 2026-10-30
- SGLang Summit 2026 sells out sponsor booths and Full Passes ahead of Nov 12–13 event — ying11231 · 2026-10-30
- OpenRouter rebuilds provider routing: 46% fewer capacity errors, 16.9% faster TTFT — steipete · 2026-10-30