NVIDIA ships Nemotron 3.5 Bolt E4B, an 8B/4B-effective model beating Gemma-4 and Qwen3.5

mervenoyann · x · 2026-10-24

NVIDIA released an E4B version of Nemotron 3.5 Bolt (8B params, 4B effective) that it says outperforms Gemma-4 and Qwen3.5 at much lower latency, scoring 70.2 on its representative benchmark. It ships with a DFlash drafter for faster decoding, and quants from ggml and unsloth are already available.

Related event: NVIDIA releases open-source small model Nemotron 3.5 Bolt E4B for 4GB on-device agents(7 posts)→

Original post →

More from Models

Models channel →