Open Source Stereo-to-Spatial Audio Model
kittenkrazy · reddit · 2026-07-18
The author open-sourced Stereo2Spatial, a model that converts stereo music into spatialized binaural mixes, releasing training/inference code, a Hugging Face model, and a Windows desktop app.
Key Implementation
- An initial VAE latent-based approach hit an audio quality bottleneck due to mismatched output distributions
- The author switched to directly modeling raw waveforms, which is more compute-intensive but yields better results
- Training instability was ultimately solved via amplitude lifting: normalizing tracks to an RMS of 0.33 before multiplying them back to expand the model's space
Training & Release
- Trained on 7,669 tracks over 20 days using 2× A6000 GPUs
- Two-stage training: short sequences for the first 10 days, long sequences for the latter 10 days
- Supports optional mix-style conditional control
- The binaural output version is released first, with a 7.1.4 version planned for the future pending more compute
- Open-sourced under Apache 2.0
Links
- Hugging Face: stereo2spatial-v2-binaural and stereo2spatial-v1
- GitHub: Training/inference repos and the Windows App are public
- Includes a detailed case study documenting the shift from the latent to the waveform approach
More from Multimodal
- Dev builds interactive 3D product experience with GPT-6 Astra + Hyper3D Rodin — nikola_mr64990 · 2026-09-11
- Using a finisher move on one mosquito with MiniMax H3 MAX — the bug survives — Hailuo_AI · 2026-09-11
- Skyfall GS Uses Flux to Refine Gaussian Splatting, Accepted at ECCV 2026 — ducha_aiki · 2026-09-11
- Lumara AI Film Festival Comes to NYC Oct 26, Top AI Filmmakers to Compete — 0xAllen_ · 2026-09-11
- Pterodactyl Detective: An AI-Generated Proof-of-Concept Trailer — PterodactylDetective · 2026-09-11
- Imperium Game Trailer Showcases AI Video Generation — keaslenyt · 2026-09-11