audio.cpp Update Brings Insanely Fast Audio Generation
Acceptable-Cycle4645 · reddit · 2026-07-15
audio.cpp releases version 0.3, adding 5 new models: Supertonic 3, MOSS-TTS-Local, MOSS-TTS-Nano, IndexTTS2, and Irodori-TTS.
Key Highlights
- Supertonic 3 achieves 200x+ real-time speed on CUDA and 6x+ on CPU, with a TTFT of 47ms in CUDA streaming mode
- A demo using The Adventures of Sherlock Holmes generated 10 hours of audio in roughly 3 minutes on an RTX 5090
- The author reverse-engineered the official ONNX inference path and rewrote it using safetensors weights
- The CUDA version is significantly faster than the Python implementation, while CPU performance is on par or slightly faster
Other Notes
- Fallback to CPU for slow nodes is a major reason for sub-optimal GPU utilization in the ONNX version
- Speed improvements for other models in v0.3 range from near-baseline to 2x+
- In long-text tests for IndexTTS2, the C++ version is 5.65x faster than Python
- GGUF support has been added and will be rolled out progressively per model
Project repo: github.com/0xShug0/audio.cpp
Related event: audio.cpp Update Boosts Local Audio Generation Speed by 200x(2 posts)→
More from coding & agent
- "Apple Dev" Grok Bot template controls Xcode, simulators and local builds on a connected Mac — tetsuoai · 2026-09-11
- Third-party Grok Bot template drives Xcode and Swift builds on a Mac from your phone — tetsuoai · 2026-09-11
- SmolVM open-sources persistent computer infrastructure for agents that outlive chat sessions — aniketmaurya · 2026-09-11
- ARRM targets silent economic regressions in AI agents that functional tests miss — Beautiful_Belt_601 · 2026-09-11
- Dev builds browser 3D pizza delivery game with Claude: physics, GPS pathfinding, traffic AI — vinishkapoor · 2026-09-11
- Build X Carousel Posts from One Wide Image: A Splitter Tool Plus YouMind Skill Workflow — sujingshen · 2026-09-11