Together's megakernel journey: built them last year, deleted them this year

simran_s_arora · x · 2026-11-17

Together team members shared their journey building the Together Compiler, via a long-form post by Dylan Lim: they helped introduce some of the first AI megakernels a year ago, and have now removed them.

A substantial first-party engineering retrospective for anyone following inference stack optimization and kernel compilation.

Related event: Together AI Drops Its Own Megakernels, Ships Agent-Tuned Compiler 28% Faster on B200(10 posts)→

Original post →

More from Infra

Infra channel →