Cross-lingual TTS cloning struggles to preserve an anime voice across languages
WowSkaro · reddit · 2026-07-22
Cross-lingual voice cloning for anime TTS
The author wants to clone the voice of a fictional anime character, Haqua (voiced by Saori Hayami), and make it speak English and Brazilian Portuguese.
They report that:
- Zero-shot cloning has not produced good results, even with short Japanese samples.
- They suspect training a model may be necessary to preserve the right timbre and intonation.
- They have already tried Microsoft Vibevoice 7B/1.5B, Qwen-3-TTS 1.7B/0.6B, and paid trials of ElevenLabs and Fish Audio without success.
- They plan to try X-Voice, which is described as being trained for cross-lingual voice cloning.
The post is essentially asking which model or training approach is best for Japanese-to-English cross-lingual voice cloning.
More from Multimodal
- Adobe Firefly video editor walkthrough: one-sentence Quick Cut turns 32s into 20s — LudovicCreator · 2026-10-26
- Hi3D V1.0 open-sourced with 2M training assets and 90% slicing success rate — kimmonismus · 2026-10-26
- Claude Can Replace Your YouTube Thumbnail Designer in 10 Minutes — thedankoe · 2026-10-26
- Multimodal AI Is Not Useless: A Practitioner Pushes Back on Growing Skepticism — thoma_gu · 2026-10-26
- One prompt, full Blender animation: dev says he never touched Blender once — iamfakhrealam · 2026-10-26
- Dense instance segmentation via Muse Wonder + SAM 3.1 on Meta's Model API — nikhilaravi · 2026-10-26