Can AI Agents Write CUDA Kernels That Beat PyTorch? A DGX Spark Benchmark

lmoroney · x · 2026-10-10

Chien Vu tested whether Claude Code agents can write CUDA kernels that beat PyTorch on an NVIDIA DGX Spark, covering softmax, layernorm, fused GELU with bias and residual, and matmul with ReLU. Every kernel passed strict correctness checks against an fp64 reference, and the writeup's most useful contribution is its discussion of proper measurement methodology for such benchmarks.

Related event: Claude Code Writes CUDA Kernels That Beat PyTorch in Tests(2 posts)→

Original post →

More from coding & agent

coding & agent channel →