NVIDIA Nemotron 3 Diarization on Baseten: 500+ real-time streams per RTX PRO 6000
baseten · x · 2026-09-24
NVIDIA Nemotron 3 Diarization is now available day 0 in Baseten's Model Library as an open, end-to-end streaming speaker diarization model replacing the usual segmentation-plus-clustering pipeline.
- A single RTX PRO 6000 sustains 500+ concurrent hour-long diarization streams (190 with transcription)
- Configurable algorithmic latency from 0.32s to 30.4s; as cheap as 1 cent per audio hour
- Labels up to 8 speakers in one pass, no clustering, unbounded audio length
- 100M-param transformer built on Streaming Sortformer; speaker activity also informs VAD, endpointing, and turn-taking for voice agents
Related event: NVIDIA Nemotron 3 Diarization Launches on Baseten with Day-0 Support(2 posts)→
More from Infra
- Claude ported itself to AMD MI355X in ~3 days, work that took dozens of engineers 6-12 months — AnushElangovan · 2026-11-11
- Analyst: AI datacenter demand will eventually be built in space — TinfoilTricorn · 2026-11-11
- Local LLMs are bare engines, cloud APIs are finished cars: what newcomers miss — Oli_Luck · 2026-11-11
- Proposal: build data centers underground and use waste heat to melt road snow — MatthewChang · 2026-11-11
- SpaceX to build $24B AI data center and natural gas power plant in Starbase, Texas — Polymarket · 2026-11-11
- Microsoft's DLSS rival Auto SR launches on Xbox Ally X with handheld 1080p and 120fps support — tomwarren · 2026-11-11