团队亲手删掉自研 Megakernel:Torch Compile 加 CUDA Graphs 达其 98% 性能

simran_s_arora · x · 2026-11-17

dylanlim's team reflects on abandoning whole-model megakernels: after months of work last year they stabilized only one model on one batch. Default Torch Compile with CUDA Graphs reaches 98% of the hand-written kernel's performance, and compiler-based optimization is 28% faster than megakernels on B200. The post contrasts the two ML optimization paradigms and argues whole-model megakernels overcomplicate things and are not an ideal optimization target.

所属事件:团队放弃自研 Megakernel,Torch Compile 方案达 98% 性能(2 条相关)→

原文链接 →

「Infra」频道最新

更多「Infra」频道 AI 资讯 →