NVIDIA Nemotron 3.5 Bolt 74B-A9B Lands on Ollama, Fits 24GB via Native 2-bit Quantization
ollama · x · 2026-10-16
Ollama announced that NVIDIA's Nemotron 3.5 Bolt 74B-A9B is now available. The vision-language model is designed to run everyday agentic tasks locally, using native 2-bit quantization to fit entirely in 24GB of memory while running alongside other applications.
Try it with: ollama run nemotron-3.5-bolt.
Related event: NVIDIA Nemotron 3.5 Bolt lands on Ollama(2 posts)→
More from Infra
- Local AI is a routing problem, not a privacy feature: where each task should run — bigdata · 2026-10-16
- Moving agent work from GPUs to CPUs for durable, predictable actions — cramforce · 2026-10-16
- First TPUv7 agentic benchmark on vLLM claims 1.42x perf-per-dollar over GB300 NVL72 — vllm_project · 2026-10-16
- Phison CEO calls CXMT memory scare a 'ghost story', warns of materials shortage — BenBajarin · 2026-10-16
- Ben Bajarin: The Future of Compute Is Fungible as Hyperscalers Design for Workload Flexibility — BenBajarin · 2026-10-16
- AirLLM runs frontier-size models layer-by-layer: 671B on 12GB VRAM — Aiden_Tech_Ai · 2026-10-16