Open Source Stereo-to-Spatial Audio Model
kittenkrazy · reddit · 2026-07-18
The author open-sourced Stereo2Spatial, a model that converts stereo music into spatialized binaural mixes, releasing training/inference code, a Hugging Face model, and a Windows desktop app.
Key Implementation
- An initial VAE latent-based approach hit an audio quality bottleneck due to mismatched output distributions
- The author switched to directly modeling raw waveforms, which is more compute-intensive but yields better results
- Training instability was ultimately solved via amplitude lifting: normalizing tracks to an RMS of 0.33 before multiplying them back to expand the model's space
Training & Release
- Trained on 7,669 tracks over 20 days using 2× A6000 GPUs
- Two-stage training: short sequences for the first 10 days, long sequences for the latter 10 days
- Supports optional mix-style conditional control
- The binaural output version is released first, with a 7.1.4 version planned for the future pending more compute
- Open-sourced under Apache 2.0
Links
- Hugging Face: stereo2spatial-v2-binaural and stereo2spatial-v1
- GitHub: Training/inference repos and the Windows App are public
- Includes a detailed case study documenting the shift from the latent to the waveform approach
More from Multimodal
- FLUX.2 Klein Drifts Hard on Character Expressions While Free Gemini Holds Likeness — wacomlover · 2026-09-11
- Tencent Hunyuan releases AuK code and weights on GitHub with ComfyUI and fine-tuning support — aigclink · 2026-09-11
- Tencent open-sources AuK, a unified 1.5B speech generation and editing model — aigclink · 2026-09-11
- Creator turns Bahamut vs Tiamat rivalry into an AI cinematic battle with Midjourney, GPT Image 2 and Seedance — azed_ai · 2026-09-11
- invideo launches AI agent-powered editor to automate repetitive editing tasks — azed_ai · 2026-09-11
- fable 5.1 recreates The Starry Night with 256,157 JavaScript brush strokes — cedric_chee · 2026-09-11