NVIDIA ships Nemotron 3.5 Bolt: 74B-A9B model in 24GB of memory
NVIDIAAI · x · 2026-10-16
NVIDIA officially announced Nemotron 3.5 Bolt 24GB, packing a 74B-total/9B-active parameter model into 24GB of memory. Optimized for RTX Spark, it runs local agents alongside your apps, balancing intelligence and speed. A notable step for consumer-local MoE inference.
Related event: NVIDIA Launches Nemotron 3.5 Bolt: 74B Model in 24GB VRAM(2 posts)→
More from Infra
- New NVFP4 trick: compressing block scales saves 45-48% per expert matrix, bit-exact — TheZachMueller · 2026-10-16
- AWS extends Claude Sonnet 3/3.5/3.6 EOL on Bedrock to November 13, 2026 — repligate · 2026-10-16
- After Apple and Meta CEOs tout Mac Silicon inference, a $10B distributed network idea resurfaces — gajesh · 2026-10-16
- NVIDIA's 74B Nemotron 3.5 Bolt, top US open-weight model, now runs locally on Mac — SumitGup · 2026-10-16
- Meta open-weights 816B Muse Spark Open, Apple tunes it for MLX on Mac — rohanpaul_ai · 2026-10-16
- Running Nemotron-3.5-Bolt-74B MoE on a single RTX 3060 with 12GB VRAM — cephaloform · 2026-10-16