Together Compute Deleted Its Megakernels: Whole-Model Kernels Overcomplicate Optimization

simran_s_arora · x · 2026-11-17

The Together Compute team reflects on helping introduce some of the first AI megakernels a year ago, noting that while whole-model megakernels are a helpful abstraction, they overcomplicate systems and are not always an ideal optimization target, so they deleted them this year.

The post dives into two contrasting paradigms of ML optimization, Torch Compile and Megakernels, and walks through how the team understood and pushed past these limitations.

Related event: Together AI Drops Its Own Megakernels; New Compiler Is 28% Faster on B200(7 posts)→

Original post →

More from Infra

Infra channel →