audio.cpp Update Brings Insanely Fast Audio Generation
Acceptable-Cycle4645 · reddit · 2026-07-15
audio.cpp releases version 0.3, adding 5 new models: Supertonic 3, MOSS-TTS-Local, MOSS-TTS-Nano, IndexTTS2, and Irodori-TTS.
Key Highlights
- Supertonic 3 achieves 200x+ real-time speed on CUDA and 6x+ on CPU, with a TTFT of 47ms in CUDA streaming mode
- A demo using The Adventures of Sherlock Holmes generated 10 hours of audio in roughly 3 minutes on an RTX 5090
- The author reverse-engineered the official ONNX inference path and rewrote it using safetensors weights
- The CUDA version is significantly faster than the Python implementation, while CPU performance is on par or slightly faster
Other Notes
- Fallback to CPU for slow nodes is a major reason for sub-optimal GPU utilization in the ONNX version
- Speed improvements for other models in v0.3 range from near-baseline to 2x+
- In long-text tests for IndexTTS2, the C++ version is 5.65x faster than Python
- GGUF support has been added and will be rolled out progressively per model
Project repo: github.com/0xShug0/audio.cpp
Related event: audio.cpp Update Boosts Local Audio Generation Speed by 200x(2 posts)→
More from coding & agent
- An MCP server signs every AI agent tool call into a verifiable Merkle chain — Funky_Chicken_22 · 2026-07-22
- Annotated transcript of a Claude Code team interview is now available — trq212 · 2026-07-22
- Claude Code skill uses 10 Markdown rules to make outputs ADHD-friendly — alex_verem · 2026-07-22
- BUZZ launches as an open-source group chat layer for teams and agents — Scobleizer · 2026-07-22
- A Firecracker-based platform says it can host 6,000 AI agents on one 256 GB server — maritime_sh · 2026-07-22
- A better path to agent autonomy is running waves, finding friction, and iterating — JnBrymn · 2026-07-22