llama.cpp lands day-0 support for Nemotron 3.5 Super VL and Bolt 74B A9B
jacek2023 · reddit · 2026-10-15
llama.cpp received day-0 support (PR #30520) for NVIDIA's two new Nemotron models—Nemotron Super 3.5 VL (120B-A12B) and Nemotron Bolt 74B A9B. Within minutes of release, unsloth also published BF16 and GGUF quantizations of Nemotron 3.5 Super VL, so local inference users can try it immediately.
More from Infra
- Vercel Sandbox Drives go GA: attach TBs of data in sub-second, fork instantly — cramforce · 2026-10-16
- NVIDIA launches RTX Spark for local AI on Windows PCs — ostrisai · 2026-10-16
- SkyRL ships Day-0 RL support for Beam with +62% LoRA decode throughput in vLLM — vllm_project · 2026-10-16
- DFlash2 delivers up to 3.03x decode-only speedup for Beam across five benchmarks — vllm_project · 2026-10-16
- vLLM's Beam serving kernels cut GB200 forward time from 8.15 to 6.47 ms at TP8 batch 128 — vllm_project · 2026-10-16
- Reflection's 501B MoE Beam hits 463 tok/s on 8x GB200 with NVFP4 at day 0 — zhyncs42 · 2026-10-16