VoiceArena launches Diarization Bench: 12 systems, NVIDIA Nemotron 3 leads at 14.72% DER
rohanpaul_ai · x · 2026-09-24
VoiceArena launched Diarization Bench, scoring 12 speaker-diarization systems on 139 real-world conversations (rooms, calls, constant interruptions) with a single metric: diarization error rate. NVIDIA's Nemotron 3 leads at 14.72% DER — but with a 250 ms timing collar it scores 4.29%, revealing how sensitive results are to the tolerance window around speaker changes. Accuracy degrades sharply with overlapping speech and more speakers. It joins STT, TTS, and conversational-agent boards on VoiceArena.
More from Research
- Stanford's DyCraft Uses Agentic Decomposition to Cut Physical Errors in Long-Horizon 4D Scene Generation — StanfordUniversity · 2026-11-11
- Bert Chan on His Unconventional Path from Side-Projects to the ALife Institute — BertChakovsky · 2026-11-11
- CGM Study of 62,000 People: Average Glucose Beats HgbA1C at Detecting High Insulin — arjunrajlab · 2026-11-11
- First open dictation benchmark: 761 recordings across 10 apps, Wispr Flow 79% vs Apple 35% — rohanpaul_ai · 2026-11-11
- Boltz models showcased at MSK Cancer Center for accelerating early-stage drug discovery — charlieharris01 · 2026-11-11
- Carlman: a Pac-Man-style game where all characters are Lenia cellular-automata solitons — BertChakovsky · 2026-11-11