On-device continual learning with Online-SDFT self-distillation

burny_tech · x · 2026-08-20

Researchers introduced Online-SDFT, enabling continual learning of Small Language Models (SLMs) directly on phones. Using self-distillation, the method treats the current model as a teacher, utilizing user interaction hindsight to generate better training targets for the student model. This allows the model to evolve in real-time based on user edits and choices without uploading private data, addressing the challenges of sparse interactions and limited compute on-device.

Original post →

More from coding & agent

coding & agent channel →