Meta launches Muse Realtime Avatar, turning voice streams into live talking characters
alexandr_wang · x · 2026-09-24
- Meta AI Research introduced Muse Realtime Avatar, which turns Muse Realtime Voice's speech token stream into expressive, interactive avatars in real time: portraits show subtle expressions, full-body illustrations gesture and shift posture, and even animals or objects stay expressive while keeping a consistent identity across conversational turns.
- Technically, voice and embodiment share one streaming pipeline: an audio-driven Diffusion Transformer conditioned on speech tokens, reference media, and a rolling window of recent video latents generates video in short causal chunks, bounding computation so generation can run for the whole conversation.
- Everything generated is watermarked as AI with no added latency, forming the foundation for Meta's realtime embodied AI products. Meta also ran head-to-head tests against Runway Characters and HeyGen LiveAvatar, saying people preferred Muse.
Related event: Meta Unveils Muse Realtime Avatar: Sub-second Realtime Digital Humans(18 posts)→
More from Multimodal
- Ditto launches swap-anything video tool to replace any video's main character — yoobinray · 2026-11-12
- Fable 5.2 impresses with pixel art gaussian splats, posts go viral — Flomerboy · 2026-11-12
- Seedream 5.5 nails a consistent character sticker set at just $0.02 per image — azed_ai · 2026-11-12
- Ant Group's open-source Ming-3.0-tts-0.5B tops Open TTS Leaderboard with 0.88 WER — NielsRogge · 2026-11-12
- Viggle Remake recreated in ComfyUI: swap any character in your videos with MiniMax H3 — TheLocalLab · 2026-11-12
- Pika Integrates Seedream 5.5: Split Images Into 100+ Layers for Precise Multi-Turn Edits — aziz4ai · 2026-11-12