NVIDIA Releases Audio2Face-3D for Audio-Driven Facial Animation
tom_doerr · x · 2026-08-23
NVIDIA has released Audio2Face-3D, technology that generates high-fidelity 3D facial animation from an audio source, supporting both pre-recorded files and real-time streams.
Core Capabilities:
- Accurate Lip-sync: Synthesizes precise motion of the jaw, tongue, and eyes based on phonetic analysis.
- Nuanced Emotion: Infers subtle emotional expression from speech tone, combined with detailed facial skin deformations.
- Flexible Driving: Drives character performance via direct mesh deformations, joint transformations, or blend shape weights.
Toolkit:
The hub provides pre-trained models, a development SDK, plugins for Autodesk Maya and Unreal Engine 5, and sample datasets.
More from Multimodal
- FLUX 3 Image Klein lands on fal: box-drawn layouts, multi-reference placement, style transfer — bfl_ai · 2026-10-16
- SGLang ships Day-0 support for FLUX 3 Image Klein: 10 reference images, BF16/FP8/NVFP4 variants — ying11231 · 2026-10-16
- Higgsfield teases Kling 4.0 rollout with a monkey-driven demo video — azed_ai · 2026-10-16
- Halcyon early-fusion image models match late-fusion with 275x less pretraining compute, open-sourced — davidwromero · 2026-10-16
- Running Wan2.1 14B FP16 on a 12GB laptop GPU: VRAM swap stress test finishes in 4m11s — RYuu-1120 · 2026-10-16
- Striking Midjourney generations: black holes and planetary aesthetics — ciguleva · 2026-10-16