NVIDIA Releases Nemotron 3.5 Bolt E4B: 4GB On-Device Model with 80% Fewer Output Tokens
heatOverflower · reddit · 2026-10-31
NVIDIA released Nemotron 3.5 Bolt E4B (4GB), post-trained from Gemma 4 E4B for voice/device assistants, interactive characters, and robotic/IoT interfaces on RTX, Jetson, RTX Spark, and DGX Spark. NVIDIA claims 40% higher average quality vs its prior model on conversational agent benchmarks and up to 80% fewer output tokens vs peers. Weights are on Hugging Face.
More from Infra
- Altman says owning RAM is wasteful; netizen flexes 64GB running Hello World — SuB8u · 2026-10-31
- xAI-adjacent concept: lunar mass drivers to launch 1000+ TW/year of AI satellites — XFreeze · 2026-10-31
- Who Can Actually Run 500B+ Models Locally? Data Points Wanted — HankYeomans · 2026-10-31
- OpenCode Serves ~10T Tokens on a Single Rack; Most Startups Need Far Less GPU — JoshPurtell · 2026-10-31
- The AI race is now an infrastructure race: Blackwell packs 208B transistors and 1.8TB/s NVLink — Olivier__OG · 2026-10-31
- Inference optimization race heats up: practitioners now want fast, cheap 'good enough' models, not the absolute best — bendee983 · 2026-10-31