Alibaba's Qwen3.8-LiveTranslate does real-time speech translation with 2.3s lag and speaker separation
xiaohu · x · 2026-09-19
Alibaba's Qwen team released Qwen3.8-LiveTranslate, a real-time speech-to-speech translation model, with a streaming API (qwen3.8-livetranslate-flash-realtime) on Alibaba Cloud Bailian.
- Thinker–Talker architecture: Thinker interleaves video frames, audio, source text, and translation in one temporal stream; Talker synthesizes translated speech that preserves each speaker's voice, built on a Hybrid MoE backbone.
- Interleave streaming cuts translation lag in the FLEURS benchmark from 2.8s to 2.3s behind the speaker.
- Key features: streaming multi-speaker diarization (spk1/spk2 labels) with per-speaker voice preservation, simultaneous source + translated text output for bilingual subtitles, and disambiguation of names/references using long context and camera frames.
More from Models
- Community asks Moonshot when Kimi K3.1 model weights will drop — bgmshana · 2026-11-04
- Meta's Muse Spark Open license counts distilled models as derivatives — aidenclarke_12 · 2026-11-04
- Tencent Hy4 trails GPT-6.1 on hard tests as Kimi K3.1 Pro beats it on two benchmarks — heyshrutimishra · 2026-11-04
- Tencent's Hy4 agent self-trained a smaller model that beat Tencent's own baseline — heyshrutimishra · 2026-11-04
- Hy4 tops open models in finance eval at 3.04, hallucination rate cut to 5.45% — heyshrutimishra · 2026-11-04
- Tencent Hunyuan teases upcoming LMArena debut — TencentHunyuan · 2026-11-04