LEGATO 2 Sheet Music Recognition Model Cited and Used in GPT-6 Astra Report
alisawuffles · x · 2026-09-05
Guang Yang and colleagues discovered their work was cited in the GPT-6 Astra report, with OpenAI even using the LEGATO camera subset for its optical music recognition (OMR) eval.
The team has since released LEGATO 2 (arXiv:2607.05769), a pipeline for extracting symbolic notation and semantic knowledge from sheet music images:
- First large-scale neural OMR model that reads music system-by-system along the horizontal lines of notation, enabling scaling to arbitrarily long inputs
- First OMR model generating symbolic transcriptions with embedded text such as titles and annotations
- Combines system-level segmentation with an autoregressive vision-LM to capture both local notation and score structure
- Consistently outperforms prior state of the art; symbolic transcriptions also improve frontier LLMs' interpretation of dense musical documents
More from Models
- Claimed GPT-6 Astra + H3 Max combo builds an insanely fast realtime Blender renderer — jfischoff · 2026-09-06
- Unverified leak: OpenAI's post-Astra model to ship as 'AGI' with real-time actions — imjustnewatai · 2026-09-06
- Early Astra hands-on: code quality and data analysis feel incremental, says developer — xeophon · 2026-09-06
- Providers wage price war over serving DeepSeek-v4-flash, user burns massive tokens for a few dollars — MaziyarPanahi · 2026-09-06
- Annoyed by 'maximum length' prompts? Refreshing the page lets you keep chatting — hi-sci-collab · 2026-09-06
- GPT-6 builds a full 3D Roguelike level in Godot using just 3% of a 20X quota — op7418 · 2026-09-06