MuScriptor: Open-Source Multi-Instrument Transcription
kyutai · hf · 2026-07-15
MuScriptor is an open-weight model designed for multi-instrument music transcription, aiming to solve the issue where existing methods only work well on single instruments and generalize poorly to real-world, complex mixes.
The authors' approach includes:
- Pre-training on synthetic data, followed by fine-tuning with real-world music audio.
- Conducting reinforcement learning-style post-training to enhance real-world applicability.
- Introducing instrument presence conditioning, allowing transcription results to be customized by specific instruments.
The paper/project claims that MuScriptor performs effectively on real-world recordings across various musical genres.
More from Multimodal
- FastH3-Live hits 22fps: acceleration node benchmarks and the --vram-headroom trick — spartong945 · 2026-09-11
- Midjourney style code share: --sref 2912175708 — tisch_eins · 2026-09-11
- Astra storyboards plus Minimax H3 per-shot generation boost video success rates — Hailuo_AI · 2026-09-11
- MiniMax H3 MAX nails cooking anime clips: 15-second curry demo with prompts shared — Hailuo_AI · 2026-09-11
- MiniMax Music Production Toolkit 2.5 for ComfyUI adds full mastering chain — Vivid_Promise1700 · 2026-09-11
- New Node Finder for ComfyUI ranks fresh nodes by star velocity and recency — Luke2642 · 2026-09-11