Real-time Piano Autocomplete on iPhone using a 125M Model

JeremyCMorgan · x · 2026-08-28

Simon Edwardsson details training a 125M-parameter transformer to autocomplete piano performances in real-time (108 notes/sec) on an iPhone 15. After 14 experiments, the biggest wins came from MIDI tokenization, aggressive data cleaning, and DPO post-training, rather than scaling up parameters.

Original post →

More from Infra

Infra channel →