NVIDIA Open-Sources VoiceChat, a Full-Duplex Speech-to-Speech Model with Tool Calling
chaumian · x · 2026-09-22
NVIDIA's NemotronLabs team released a paper on VoiceChat, an open full-duplex speech-to-speech model that stands out for supporting tool calling during real-time voice conversations.
Unlike turn-based voice assistants, the full-duplex design lets the model listen and speak simultaneously, closer to natural human conversation. Tool calling enables the model to trigger external actions within a purely voice-native interaction—a key step toward practical voice agents. The paper lists a large author team of NVIDIA speech researchers.
Related event: NVIDIA Open-Sources Full-Duplex VoiceChat with Tool Calling(2 posts)→
More from Multimodal
- NVIDIA's Déjà View: 117M looped transformer matches models 10x larger at 3D reconstruction — NVIDIAAI · 2026-11-12
- Midjourney V9 rumored to launch soon with images, 3D and vector support — aziz4ai · 2026-11-12
- Adobe embeds generative AI in Premiere and Firefly with a built-in creative agent — emmanuelvivier · 2026-11-12
- Grok can now generate images in-app, and users are already making benchmark chart memes — ChrisUniverse · 2026-11-12
- A LoRA Is All You Need to Turn a Speech LLM Full-Duplex — kastnerkyle · 2026-11-12
- Runway teases triple bet: real-time avatars, interactive worlds, robot action models — c_valenzuelab · 2026-11-12