Hazy lab: we built the first AI megakernels last year — this year we deleted them

simran_s_arora · x · 2026-11-17

Hazy lab (home of the S4-vs-FlashAttention tradition) publishes a retrospective: a year ago they helped introduce the first AI megakernels, which saw wide adoption. Their conclusion now is that whole-model megakernels, while a helpful abstraction, overcomplicate things and aren't always the ideal optimization target.

The team wrote up their journey in a long-form post, with a deep dive contrasting two ML optimization paradigms—Torch Compile and Megakernels—and how to push past megakernel limitations ("this year we deleted them").

Original post →

More from Infra

Infra channel →