Compiler-backed agent Benzi hits 78.2% SWE-bench Verified at under 10 cents per fix
DonkeyTheKing · reddit · 2026-10-04
Benzi is an open-source coding agent that first compiles your codebase into a resolved, queryable map of calls, data flow, control flow, and class hierarchy, then reads, explains, runs, edits, and verifies code against it — with a runtime tracer to settle what static analysis can't. It scores 78.2% (391/500) on SWE-bench Verified using DeepSeek V4 flash at under 10 cents per fix. On another bug-fixing benchmark it reads 2x less source code than Claude Code (9,125 vs 20,704), 4x less than DeepSeek Harness (43,598), and 6x less than OpenCode (65k+). Available as a VS Code extension and headless; the compiler is also exposed separately over MCP tools without the agentic loop.
More from coding & agent
- Leave comments on Paper, agents turn them into motion code: 'design to get a better prompt' — davidhoang · 2026-10-04
- A few nights with Claude and three.js: a water sim in the browser that still wants a duck — minchoi · 2026-10-04
- "It Sends a System Message to My Agent Fleet": Reboots Now Brief AI Agents Like Engineers — kevinnbass · 2026-10-04
- Copilot fixes Surface Book 3 camera driver on Linux in two hours — marian_nmt · 2026-10-04
- New Opus went from flawless to average, says dev, but still beats Opus 5 — haider1 · 2026-10-04
- Redditor burns through entire ChatGPT Go plan in one day building a Minecraft mod — SuperJogosDBZ · 2026-10-04