Kernaut: coding agents discover ML kernels automatically as 22-58% of LLM-generated ones fail at scale

Cohere · youtube · 2026-11-14

PhD candidate Richard Cornelius Suwandi (CUHK-Shenzhen) presented Kernel Autoresearch (Kernaut) at Cohere Labs Open Science Community.

The problem: kernels encode inductive biases of many ML models, but automating their design involves a trade-off. Fixed grammars guarantee validity but limit the search space; free-form LLM programs remove that limit but are brittle — in tests, 22–58% of LLM-generated kernels that pass simple numerical checks fail at different scales or dimensions.

Method:

Results: discovered kernels transfer to unseen tasks (black-box optimization, enzyme kinetics) without further LLM calls, and remain interpretable programs humans can refine.

Suwandi co-developed OpenEvolve, an open-source evolutionary coding agent inspired by DeepMind's AlphaEvolve, and co-founded AIDDA. Paper: arxiv.org/abs/2610.10394.

Original post →

More from coding & agent

coding & agent channel →