Megakernels help when launch profile is the bottleneck, says _xjdr

_xjdr · x · 2026-11-20

xjdr argues that "we don't do megakernels" is a naive take. Megakernels help when your launch profile is the major bottleneck: if you know the model you're running and the batch size, they let you omit redundant loads and pointless shape conversions, improving inference efficiency.

Original post →

More from Infra

Infra channel →