Alibaba open-sources TaoMate-H3: 3-step streaming audio-video generation, 27x faster first segment
机器之心 · wechat · 2026-10-02
Alibaba's TaoLive AIGC team open-sourced TaoMate-H3, an audio-video joint streaming generation model built on MiniMax H3, combining 3-step LoRA inference with autoregressive generation for minute-long videos with dialogue, singing, and ambient sound. On 8×H20, DiT compute dropped from 169.6s to 14.8s (11.45x) and first-segment latency from 170s to 6.1s (27.66x). Key techniques include SelfForcing training, rolling audio-video KV cache, continuous RoPE time encoding, and audio-trajectory guidance. Code and LoRA weights are on GitHub and Hugging Face.
More from Infra
- Investor: market hates uncertainty more than money after Nvidia earnings — MartinGTobias · 2026-11-19
- SGLang ships Day-0 serving support for new model DaisyRose-27B — ying11231 · 2026-11-19
- Linux LTS patch flood: 3318 patches for 6.6 alone, 'no way humans are reviewing this' — pkqzy888 · 2026-11-19
- DaisyRose-27B's in-house sandbox: ~80% cheaper than cloud providers, 99.95% success rate — BanghuaZ · 2026-11-19
- Tencent's 220B Hy4-flash quantized to 49 GB weights, runnable on 64 GB VRAM — gladkos · 2026-11-19
- Berth: a lightweight open-source GPU resource manager with multi-GPU scheduling and VRAM parking — Distinct-Pie2389 · 2026-11-19