NVIDIA Launches Nemotron 3.5 Lightning: A 30B MoE Model Built for Agents
baseten · x · 2026-08-11
NVIDIA has released the Nemotron 3.5 Lightning model, now available on the Baseten platform. Distilled from the larger Nemotron 3 Ultra, this model is specifically designed for long-running agentic workflows. It features a 30B Mixture-of-Experts (MoE) architecture with only 3B active parameters and supports a 1 million token context length.
According to official and production testing data, the model delivers 4x higher throughput, 50% lower costs, and 63.4% fewer output tokens compared to similar-sized open models. Additionally, the CodeRabbit team fine-tuned this model using Baseten Training, achieving an 80.4% routing agreement, a 4.6% increase over the 75.8% baseline.
Related event: NVIDIA Unveils Nemotron 3.5 Lightning and NeMo Switchyard Router(55 posts)→
More from coding & agent
- Meta open-sources Muse Spark Open agent model with day-0 TPU support in SGLang — BanghuaZ · 2026-10-16
- Saying "load-bearing" in your prompt makes Opus 5.5 stop holding back — zacharynado · 2026-10-16
- You.com partners with Paperclip to give every agent live web access — PolarBearby · 2026-10-16
- I priced every Grok Bot call: $20 to $200 plan in 5 days, long jobs eat 52% — jonathanmalkin · 2026-10-16
- GitHub is criminally underrated as a free data store, devs argue — blelbach · 2026-10-16
- Claude Desktop doesn't support MCP sampling — here's a workaround for two-way MCP apps — wuj · 2026-10-16