Gemini 4 Neon autonomously writes GPU kernels, 5.9x faster prefill on AMD hardware

sebkrier · x · 2026-11-22

An AMD engineer gave Gemini 4 Neon Thinking Machines' Inkling 2 Mini GGUF and let it handle the entire optimization on a Strix Halo (8060S) GPU: writing kernels, profiling, finding bottlenecks, and benchmarking autonomously. It worked 4.3 hours with 490 tool calls, beating llama.cpp on ROCm:

Generated kernels reached 80% of the GPU's theoretical memory bandwidth. A model autonomously writing and optimizing low-level GPU code to this level is a striking demo of agent capability in systems engineering.

Original post →

More from coding & agent

coding & agent channel →