Cross-lingual TTS cloning struggles to preserve an anime voice across languages
WowSkaro · reddit · 2026-07-22
Cross-lingual voice cloning for anime TTS
The author wants to clone the voice of a fictional anime character, Haqua (voiced by Saori Hayami), and make it speak English and Brazilian Portuguese.
They report that:
- Zero-shot cloning has not produced good results, even with short Japanese samples.
- They suspect training a model may be necessary to preserve the right timbre and intonation.
- They have already tried Microsoft Vibevoice 7B/1.5B, Qwen-3-TTS 1.7B/0.6B, and paid trials of ElevenLabs and Fish Audio without success.
- They plan to try X-Voice, which is described as being trained for cross-lingual voice cloning.
The post is essentially asking which model or training approach is best for Japanese-to-English cross-lingual voice cloning.
More from Multimodal
- FLUX.2 Klein Drifts Hard on Character Expressions While Free Gemini Holds Likeness — wacomlover · 2026-09-11
- Tencent Hunyuan releases AuK code and weights on GitHub with ComfyUI and fine-tuning support — aigclink · 2026-09-11
- Creator turns Bahamut vs Tiamat rivalry into an AI cinematic battle with Midjourney, GPT Image 2 and Seedance — azed_ai · 2026-09-11
- invideo launches AI agent-powered editor to automate repetitive editing tasks — azed_ai · 2026-09-11
- fable 5.1 recreates The Starry Night with 256,157 JavaScript brush strokes — cedric_chee · 2026-09-11
- GPT-6 Astra + Hyper3D Rodin MCP Generates 3D Assets in One Agent Flow — ahuja_priyank · 2026-09-11