Microsoft's TeleTune evolves agent skills from offline user telemetry

EliasEskin · x · 2026-10-27

TeleTune, a Microsoft Research project from an internship effort by UNC's Justin Chen, learns reusable computer-use agent skills from offline user telemetry. The paper argues telemetry is a scalable source of procedural software-usage knowledge, but extracting skills requires addressing challenges like goal underspecification, since logs don't record the user's intent. Authors include Justin Chih-Yao Chen, Elias Stengel-Eskin, Ben Van Durme, and Harsh Jhamtani (October 2026).

Original post →

More from Research

Research channel →