MuScriptor: Open-Source Multi-Instrument Transcription
kyutai · hf · 2026-07-15
MuScriptor is an open-weight model designed for multi-instrument music transcription, aiming to solve the issue where existing methods only work well on single instruments and generalize poorly to real-world, complex mixes.
The authors' approach includes:
- Pre-training on synthetic data, followed by fine-tuning with real-world music audio.
- Conducting reinforcement learning-style post-training to enhance real-world applicability.
- Introducing instrument presence conditioning, allowing transcription results to be customized by specific instruments.
The paper/project claims that MuScriptor performs effectively on real-world recordings across various musical genres.
More from Multimodal
- FLUX.2 Klein Drifts Hard on Character Expressions While Free Gemini Holds Likeness — wacomlover · 2026-09-11
- Tencent Hunyuan releases AuK code and weights on GitHub with ComfyUI and fine-tuning support — aigclink · 2026-09-11
- Creator turns Bahamut vs Tiamat rivalry into an AI cinematic battle with Midjourney, GPT Image 2 and Seedance — azed_ai · 2026-09-11
- fable 5.1 recreates The Starry Night with 256,157 JavaScript brush strokes — cedric_chee · 2026-09-11
- GPT-6 Astra + Hyper3D Rodin MCP Generates 3D Assets in One Agent Flow — ahuja_priyank · 2026-09-11
- Five tells that still make AI video read as AI, from physics glitches to missing operators — NewPhoneWhotiz · 2026-09-11