Open Source Stereo-to-Spatial Audio Model
kittenkrazy · reddit · 2026-07-18
The author open-sourced Stereo2Spatial, a model that converts stereo music into spatialized binaural mixes, releasing training/inference code, a Hugging Face model, and a Windows desktop app.
Key Implementation
- An initial VAE latent-based approach hit an audio quality bottleneck due to mismatched output distributions
- The author switched to directly modeling raw waveforms, which is more compute-intensive but yields better results
- Training instability was ultimately solved via amplitude lifting: normalizing tracks to an RMS of 0.33 before multiplying them back to expand the model's space
Training & Release
- Trained on 7,669 tracks over 20 days using 2× A6000 GPUs
- Two-stage training: short sequences for the first 10 days, long sequences for the latter 10 days
- Supports optional mix-style conditional control
- The binaural output version is released first, with a 7.1.4 version planned for the future pending more compute
- Open-sourced under Apache 2.0
Links
- Hugging Face: stereo2spatial-v2-binaural and stereo2spatial-v1
- GitHub: Training/inference repos and the Windows App are public
- Includes a detailed case study documenting the shift from the latent to the waveform approach
More from Multimodal
- Gemini Omni Flash turns a boat cabin into a cave in Flow by Google — chrisfirst · 2026-07-22
- A simple workflow to turn a photo into an image prompt using Gemini, Grok, or GPT Image — harshitagu72595 · 2026-07-22
- A Reddit user proposes a consistency LoRA to keep anime and game scenes visually stable — ThirdWorldBoy21 · 2026-07-22
- Hand-painted figurines run through Seedance look eerily alive — cocktailpeanut · 2026-07-22
- An AI agent-made bayou country music video is making the rounds on Reddit — LazyKaleidoscope4696 · 2026-07-22
- Testing Qwen 3 Image: Map Borders Shift Based on Prompts, Includes Chinese Labels — NirantK · 2026-07-22