Sound / Vision: open-source self-hosted app turns an idea into songs, album art, and AI music videos
LawrenceOfTheLabia · reddit · 2026-10-11
A Reddit dev open-sourced Sound / Vision, a self-hosted web app that takes you from an idea to a finished song, album art, and a lip-synced music video on one local Linux GPU box.
What it does
- Songs via YuE2, ACE-Step 1.5, or MiniMax Music 3 in local ComfyUI; multiple takes, covers, or your own tracks
- Analysis: stems, beats, sections, word-level lyric timing
- Album art from Krea 2 / Qwen Image 2.1 in one house style
- Videos: animated art, code-written motion graphics timed to the song, and lip-synced MVs via MiniMax H3
- Auto-cut TikTok/Reels/Shorts clips; Influence Engine trains a 'sound' to steer YuE2
Architecture & limits
- FastAPI systemd service + Dockerized ComfyUI; LAN access without keys, token pairing for outsiders
- Use a local LLM via Ollama or your own Claude/ChatGPT/Grok subscription (no API keys); MCP servers for hosted models or ElevenLabs Music
- Needs a 24–32 GB NVIDIA GPU (built on a 5090), 200 GB disk, 1h first install
- YuE2 is non-commercial; MiniMax H3 excludes US/EU/UK/Korea. MIT licensed.
More from coding & agent
- GPT Researcher crosses 30k GitHub stars, built and maintained almost entirely by community — EdenEmarco177 · 2026-10-11
- shadcn: AI hasn't sped up abstraction design yet, it just helps me fail faster — shadcn · 2026-10-11
- Free 7-week production Agentic RAG course hits 9.7k stars on GitHub — mdancho84 · 2026-10-11
- Arize AI shows how agents can self-learn from production traces to fix their own bugs — AI Engineer · 2026-10-11
- Power User Runs AI Coding Agent 24/7, Burns Through Weekly Limit in Two Days — gandamu_ml · 2026-10-11
- Hallucinated model name sat in codebase for months, caught 6 days before a deprecated model shutdown — Trout_dev · 2026-10-11