AVO agents evolve attention kernels beating FlashAttention-4 by 10.5% on B200

bingxu_ · x · 2026-09-25

AVO, accepted at NeurIPS 2026, replaces fixed mutation/crossover heuristics in evolutionary search with autonomous coding agents that propose, repair, critique and verify kernel edits. After 7 days of autonomous evolution on Blackwell B200, AVO discovers attention kernels up to 3.5% faster than cuDNN and 10.5% faster than FlashAttention-4; transferring to grouped-query attention takes just 30 more minutes for up to 9.3% gains.

Original post →

More from Infra

Infra channel →