NetEase Youdao open-sources Confucius4-R2T2 and T3PO, a full real-time voice AI stack
thetripathi58 · x · 2026-09-23
NetEase Youdao open-sourced two models that hit #1 on Hugging Face Trending in their categories: ASR model Confucius4-R2T2 and 14B streaming translation model Confucius4-T3PO.
- R2T2 is built for voice agents: committed transcript chunks become permanent, new text is only appended, never rewritten — so "book" flipping to "look" can't derail a search or booking. Stable input equals reliable voice AI
- T3PO decides when to READ/WRITE over R2T2's stable incremental text and translates incrementally; audio is processed in slices as small as 160ms (streaming step, not end-to-end latency)
- Together they form a fully open-source real-time voice/interpretation stack for live interpretation, meetings, and voice agents: your agent can start understanding while the user is still speaking
Related event: NetEase Youdao Open-Sources Two Speech Models Topping Hugging Face Trending(5 posts)→
More from coding & agent
- Deleting Three Agents for 40 Lines of Python Cut Latency 9s to 800ms and Cost 75% — Prestigious_Style267 · 2026-09-23
- Open-Source Digital Twins: Stateless Fake SaaS Services for Testing Gmail/Slack Agents — aofu_dev · 2026-09-23
- Automation vs Agentic AI: Most 'Agents' Are Just Scripts, LLM Only Fills the Gaps — forevergeeks · 2026-09-23
- Agentic DORA metrics: tracking PR start-to-merge to measure AI coding agents — vincent_koc · 2026-09-23
- Replacing Claude & Chrome with Strawberry, an AI browser with built-in agents — damienghader · 2026-09-23
- Claude Opus 5.5 impresses with TTFT and throughput in Claude Code daily use — rachittshah · 2026-09-23