Fish Audio S2 fork jumps from 1.2 to 23 t/s on Apple Silicon
fogonthebarrow-downs · reddit · 2026-07-23
A developer forked Fish Audio’s S2 and optimized it for Apple Silicon, claiming a huge speedup on MPS.
- Through quantization and runtime changes, throughput reportedly improved from about 1.2 tokens/s to 12.4 t/s in bf16 and 23 t/s in int8.
- The gains came mostly from KV-cache reuse, GQA expansion, an int8 kernel for MPS, Torch compile on Metal/Inductor, and sub-batch streaming.
- The benchmark was run on an M5 Pro 48GB, and the author is asking other Apple Silicon users to reproduce it on different chips.
- This is a useful local TTS optimization post for people working on Apple-device inference.
More from Multimodal
- AI video is a new medium, not cinema or animation — and it's perfect for depicting dreams — Kyrannio · 2026-10-27
- Dad turns his toddler's 31-year-old quote into a song via SUNO kids' choir — NathanpmYoung · 2026-10-27
- Band's local-AI music video hits 200k views: 900 generations kept 64, 3-second clips beat face drift — Hwang0500 · 2026-10-27
- Adobe Firefly video editor walkthrough: one-sentence Quick Cut turns 32s into 20s — LudovicCreator · 2026-10-26
- Hi3D V1.0 open-sourced with 2M training assets and 90% slicing success rate — kimmonismus · 2026-10-26
- Claude Can Replace Your YouTube Thumbnail Designer in 10 Minutes — thedankoe · 2026-10-26