Sesame Releases TurnBench for Real-Time Conversational Turn-Taking
shinjiw_at_cmu · x · 2026-08-29
Sesame released TurnBench, a multi-domain benchmark for evaluating "when to speak and when to yield" in real-time conversations. It features a 30-hour dual-channel corpus with hand-annotated end-of-turn and interruption events. The leaderboard ranks models by recall, FPR, and latency; Voice Activity Projection leads with 0.845 recall, while OpenAI Realtime (Semantic VAD) scores 0.303. The training set, otoSpeech, is available on Hugging Face.
Related event: Sesame Releases TurnBench for Evaluating Voice AI Turn-Taking(2 posts)→
More from Research
- OpenAI gives $5M to Simons Foundation's $15M push to help mathematicians navigate AI-era results — OpenAI · 2026-10-15
- DeepPhylo infers phylogenetic trees without unrealistic evolutionary assumptions — anshulkundaje · 2026-10-15
- Wander preprint explores graph foundation models via shared objective and random-walk interface — mmbronstein · 2026-10-15
- CHI Reviewer: AI Slop Is Real, but Unusually Rigorous Papers Still Getting Through — IanArawjo · 2026-10-15
- Into the Unknown: CMU benchmark finds 114 of 135 AI-written research papers fail integrity checks — arankomatsuzaki · 2026-10-15
- Benchling launches Science Foundries: multiplayer agent swarms for end-to-end science workflows — nlarusstone · 2026-10-15