Audio2Face-3D Ported to Apple Silicon for Local 3D Animation
ivan_digital · reddit · 2026-07-05
Developers have ported NVIDIA's Audio2Face-3D (audio-driven 3D facial animation) model to run locally on Apple Silicon as part of an open-source (Apache 2.0) speech-swift package. The forward pass uses a handwritten MLX compute graph, eliminating the need for an ONNX runtime. It takes a WAV input and outputs timestamped facial animation coefficients with emotion adjustment support, releasing three MLX models: James, Claire, and Mark. The package also provides local TTS and voice cloning, enabling an offline 'text -> cloned voice -> facial motion' pipeline on Mac.
More from Multimodal
- Techhalla shares full 2D-to-3D workflow with Opus 5.5 and Kling 4.0 prompts — techhalla · 2026-10-26
- Rebuilding real events as photoreal SF digital twins, filmed cinematically from a phone — bilawalsidhu · 2026-10-26
- How to turn Claude Code into a video editor: a full reel in 19 minutes — PrajwalTomar_ · 2026-10-26
- "Recursive eyes" prompt idea produces mesmerizing spiral of infinitely recurring faces — LudovicCreator · 2026-10-26
- Black Forest Labs open-sources 5.6B FLUX 3 Image Klein, +91 Elo with 38% fewer params — dl_weekly · 2026-10-26
- Claude + HyperFrames can clone any short-video style in minutes — petergyang · 2026-10-26