Autoregressive models nailed sheet music back in 2019 — LLMs just haven't been fed it
fly_ght · x · 2026-09-07
In a debate on whether LLMs can master creative writing and music, the author argues the limitation is economic, not technical: autoregressive models were already generating sheet music very well in 2019, and the only reason LLMs haven't been trained on it is that the investment doesn't pay off. His interlocutor counters that RLHF still hasn't made models meaningfully better writers.
Related event: Coconet Generated Bach-Style Scores Back in 2019(2 posts)→
More from AGI Musings
- MIT Tech Review: as AI makes output cheap, judgment becomes the real edge — Olivier__OG · 2026-09-07
- Gary Marcus amplifies theory: delayed Anthropic IPO means racing cheap open-source models — GaryMarcus · 2026-09-07
- "Only 3 years": AI progress outpacing public perception, most still think GPT-3.5 is the norm — RachelVT42 · 2026-09-07
- Math community will pivot to pro-AI within a year, claims researcher Rex Douglass — RexDouglass · 2026-09-07
- The case against conversational interfaces: natural language is not the next paradigm — julianlehr · 2026-09-07
- Vercel CEO Guillermo Rauch: His Agent Runs Product Reviews, He Only Joins When It Fails — cen6wkf · 2026-09-07