Qwen3-TTS 1.7B hits 1.6x real-time voice cloning on CPU via llama.cpp
alexcovo_eth · x · 2026-09-11
A developer benchmarked Qwen3-TTS-12Hz-1.7B VoiceDesign on mainline llama.cpp (Q4KM): on an i7-12700H CPU it generated 3.44s of studio-grade cloned audio in 2.13s (1.61x real-time, zero VRAM, 8GB RAM); on an RTX 4060 Laptop it hit 3.22x real-time with only 3.5GB VRAM peak. No reference audio or fine-tuning needed — you describe age, gender, accent, mic proximity and emotion in plain text, and the zero-shot cloning penalty is nearly nonexistent.
More from Infra
- Cloud capacity crisis is now an AI architecture problem, argues new newsletter — DavidLinthicum · 2026-10-26
- SpaceX files $40B GPU financing commitment with Apollo, already at 1.7GW — XFreeze · 2026-10-26
- Meta plans to raise up to $95B to fund massive AI expansion — Polymarket · 2026-10-26
- Nebius CEO: Debt Markets Closed for Neoclouds Last Week, Leaning on Customer Advances — zephyr_z9 · 2026-10-26
- CoreWeave 5-year CDS spikes to ~1,100bps as market fears AI bubble starts as credit event — kimmonismus · 2026-10-26
- AI demand reshapes cloud computing: scarce capacity and long-term deals replace on-demand — DavidLinthicum · 2026-10-26