Zonos3-Mini Voice-Cloning TTS Hits SGLang-Omni: 57ms First Audio on One H100

spikedoanz · x · 2026-11-10

ZyphraAI's Zonos3-Mini voice-cloning TTS model runs on SGLang-Omni from day 0. It's an 800M-parameter MoE with 80M active parameters per token, streaming first audio in just 57 ms on a single H100 — well suited for real-time, low-cost voice deployments.

Original post →

More from Infra

Infra channel →