Hacker Wires Idle Strix Halo NPU into a Coding Agent, Beats Grep at Semantic Search

stereohype · reddit · 2026-10-08

Reddit user stereohype's Halogen project exposes AMD Strix Halo's idle XDNA2 NPU via OpenAI-style endpoints and wires four models into a coding agent: semantic codebase search (15/20 vs 9/20 for grep on keyword-poor queries), near-duplicate file scanning (45 pairs in 8.4s), fast binary decisions (120ms, 78% accuracy), and injection screening (42% recall, 0 false positives, shipped as fail-open). A placebo-controlled experiment showed the NPU only accelerates 'where to look' (95% of task time stays GPU-bound), cutting a keyword-poor task from 18.7 to 13.6 minutes. Halogen 0.17.1 reduced NPU latency 30x and decode 40%.

Original post →

More from coding & agent

coding & agent channel →