Engineer calls megakernel hype a psyop: CUDA graphs already express a strict superset

mike64_t · x · 2026-11-10

mike64t pushes back on megakernel hype, arguing a CUDA graph of co-designed kernels expresses a strict superset of what a single megakernel can do, citing cuGraphAddBatchMemOpNode (analog of cuStreamWaitValue64) enabling SM-free waiting. A substantive debate in the GPU kernel engineering community on megakernel vs. multi-kernel orchestration.

Original post →

More from Infra

Infra channel →