Amazon's CompoundingKernel: 1000+ agents write GPU kernels from scratch, tops 3 SOL-ExecBench boards

dair_ai · x · 2026-11-18

Amazon researchers present CompoundingKernel, a self-improving agent system that writes GPU kernels purely by search. As of Nov 2026 its kernels rank #1 on the public L1, L2 and Quantization boards of SOL-ExecBench (NVIDIA B200), are 4.40x faster than the reference baseline on 209 public problems, and all 235 problems have site-verified correct kernels.

Key design:

Main finding: the rate of reliable measurements — not the number of agents — limits how far such search scales. Over a thousand agents run at once.

Original post →

More from coding & agent

coding & agent channel →