YuE2-3B: Open Music Model With Editable Scores Beats Suno v5 on WildSongBench
realmrfakename · x · 2026-09-10
Open music generation model YuE2-3B rivals Suno v5: turn lyrics and a style prompt into a complete song with vocals and accompaniment, then shape melody and chords through an editable score. On WildSongBench, YuE2 (best-of-8) achieves the highest SongBench average among all evaluated open and proprietary models: 6.9632 vs 6.8721 for Suno v5.
Key features:
- Compose and edit: melody + chords, melody-only, or direct generation; bring your own ABC score
- Agent-based editing: turn musical feedback into score, style, and lyric revisions, then render the next version
- Run locally: 48 kHz stereo songs on a 24GB GPU without quantization
- Architecture: an AR–NAR Mixture-of-Transformers backbone writes the score and semantic tokens, then generates acoustic latents via flow matching; a VAE converts them to stereo audio
Licensed CC-BY-NC-4.0 (non-commercial), with Hugging Face loading, CFG text guidance, and separate planning/synthesis APIs.
More from Multimodal
- 10 practical ways to run Astra computer use on Premiere Pro for video editing — beechinour · 2026-10-27
- MiniMax H3 runs fully on a Galaxy S26: 5-second video with audio in ~7 minutes — BidFunny4862 · 2026-10-27
- Krea ships Premiere Pro plugin to generate video and SFX inside the timeline — lmoroney · 2026-10-27
- Wan2GP lands on Pinokio: 1-click AI video on 6GB GPUs — cocktailpeanut · 2026-10-27
- WanGP v18.81 adds Tencent's Hy-Nomas world model, playable on 8GB VRAM — cocktailpeanut · 2026-10-27
- Butter.video wins over skeptical creator with hundreds of tasteful timeline 'blocks' for video effects — beechinour · 2026-10-27