TypeSafe AI's 'Bitterest Lesson': picking the right task beats data, compute and algorithms

ZeYanjie · x · 2026-09-20

A TypeSafe AI blog post extends Sutton's bitter lesson one layer further: the true ordering is right task > data > compute > algorithms. Games make the bitter lesson visible because the task is obvious and self-play generates endless data; in the real world someone still has to choose the objective, which requires studying users, products and organizations outside ML itself. Pick the wrong task and you get beautiful loss and scaling curves for a useless model. ML research, the author argues, attacks these problems in exactly the reverse order.

Related event: The Bitterest Lesson: Picking the Right Task Beats Data and Compute(2 posts)→

Original post →

More from Research

Research channel →