MuScriptor: Open-Source Multi-Instrument Transcription
kyutai · hf · 2026-07-15
MuScriptor is an open-weight model designed for **multi-instrument music transcription**, aiming to solve the issue where existing methods only work well on single instruments and generalize poorly to real-world, complex mixes. The authors' approach includes: - Pre-training on **synthetic data**, followed by fine-tuning with **real-world music audio**. - Conducting **reinforcement learning-style post-training** to enhance real-world applicability. - Introducing **instrument presence conditioning**, allowing transcription results to be customized by specific instruments. The paper/project claims that MuScriptor performs effectively on real-world recordings across various musical genres.
More from Multimodal
- OpenArt AI demos a Video Remix tool that can transform an existing video — eyishazyer · 2026-07-21
- ElevenLabs raises ElevenMusic free usage to 400 tracks a month — lukeharries · 2026-07-21
- Google Gemini now watermarks every AI video it generates — Sure_Belt9076 · 2026-07-21
- GPT Image 2 Prompt Turns Product Shots into Surreal Reality-Bending Ads — aziz4ai · 2026-07-21
- LTX 2.3 LoRA demo changes a video’s camera angle — CQDSN · 2026-07-21
- Reddit user shares a surreal ChatGPT-generated poster — Creamy-Sundae-9991 · 2026-07-21