Fish Audio S2 fork jumps from 1.2 to 23 t/s on Apple Silicon
fogonthebarrow-downs · reddit · 2026-07-23
A developer forked Fish Audio’s S2 and optimized it for Apple Silicon, claiming a huge speedup on MPS.
- Through quantization and runtime changes, throughput reportedly improved from about 1.2 tokens/s to 12.4 t/s in bf16 and 23 t/s in int8.
- The gains came mostly from KV-cache reuse, GQA expansion, an int8 kernel for MPS, Torch compile on Metal/Inductor, and sub-batch streaming.
- The benchmark was run on an M5 Pro 48GB, and the author is asking other Apple Silicon users to reproduce it on different chips.
- This is a useful local TTS optimization post for people working on Apple-device inference.
More from Multimodal
- 10 practical ways to run Astra computer use on Premiere Pro for video editing — beechinour · 2026-10-27
- MiniMax H3 runs fully on a Galaxy S26: 5-second video with audio in ~7 minutes — BidFunny4862 · 2026-10-27
- Krea ships Premiere Pro plugin to generate video and SFX inside the timeline — lmoroney · 2026-10-27
- Wan2GP lands on Pinokio: 1-click AI video on 6GB GPUs — cocktailpeanut · 2026-10-27
- WanGP v18.81 adds Tencent's Hy-Nomas world model, playable on 8GB VRAM — cocktailpeanut · 2026-10-27
- Butter.video wins over skeptical creator with hundreds of tasteful timeline 'blocks' for video effects — beechinour · 2026-10-27