NVIDIA Nemotron 3.5 Lightning Hits DeepInfra with 1M Token Context
gharik · x · 2026-08-11
DeepInfra has officially launched NVIDIA's Nemotron 3.5 Lightning model. Featuring a 30B MoE architecture with 3B active parameters, the model supports a massive 1 million token context window. It is touted as the fastest open model in its class, offering up to 4x higher throughput tailored for always-on agents.
Pricing is set at $0.05/M input tokens and $0.20/M output tokens, with full OpenAI API compatibility.
Related event: NVIDIA Unveils Nemotron 3.5 Lightning and NeMo Switchyard Router(55 posts)→
More from Infra
- Phison CEO calls CXMT memory scare a 'ghost story', warns of materials shortage — BenBajarin · 2026-10-16
- Ben Bajarin: The Future of Compute Is Fungible as Hyperscalers Design for Workload Flexibility — BenBajarin · 2026-10-16
- AirLLM runs frontier-size models layer-by-layer: 671B on 12GB VRAM — Aiden_Tech_Ai · 2026-10-16
- NVIDIA Launches cuPotential in CUDA-X to Bring AI Agents to Semiconductor Materials Simulation — tomaszbednarz · 2026-10-16
- Q4-quantized coder model on 8-core CPU builds interactive solar system demo in one shot — IntrepidMindExplorer · 2026-10-16
- TokenSpeed MLA 2 ships for Vera Rubin: up to 3.44× faster Kimi K3 decode — zhyncs42 · 2026-10-16