MuLaCover open-sources a controllable model that rebuilds any song into an AI cover
solyarisoftware · x · 2026-09-17
The HeartMuLa team released MuLaCover on Hugging Face: a controllable AI cover-song and music-remix model with weights freely downloadable (CC-BY-NC-4.0, paper arXiv:2601.10547).
- Flexible inputs: drop in any track or MIDI, swap the lyrics, and describe a vibe to rebuild the song from the ground up
- Two control paths: lyrics plus a structured one-line style prompt (topic/genre/instrument/mood fields), or melody/chord MIDI generation
- Controllable dimensions: remixes genre, instrumentation, topic, and mood; audio is first converted to symbolic melody/harmony/drums
- Setup: requires sibling checkpoints (HeartCodec, Qwen3-Embedding-0.6B, YourMT3, ChordNet), inference via the mulacover pipeline in bfloat16
More from Multimodal
- Midjourney dual --sref combo produces medieval woodcut cat knight art — sergeantsref · 2026-11-02
- Fluffy AI-generated character designs: fox girl, alien bug and cat photographer — OVolosin82152 · 2026-11-02
- Fable 5.5 reportedly one-shots animation in pure code as Anthropic's coding bet pays off — Hesamation · 2026-11-02
- FlowHMR gets 5x faster, demoing an LLM agent pipeline from video to photoreal mocap — camenduru · 2026-11-02
- Retro 1973 music video "Rock is Dead" by TECHHALLA showcases startlingly realistic AI generation — Mother-Pear-2392 · 2026-11-02
- Weekend splatting with COLMAP and Lichtfeld — janusch_patas · 2026-11-02