A 200-line ReAct harness lets open models race to fix 3 real bugs
MaziyarPanahi · x · 2026-07-25
A real bug-fixing setup shows how multiple open models can be raced against the same repository issues.
- The author used 3 hidden bugs in a real repo, with pytest as the judge.
- Local models ran on a Mac Studio: Bonsai-27B, Inkling, and gemma-4-26B, served via llama.cpp + MLX.
- A separate stronger model, Kimi K3, was called through OpenRouter until the weights become public.
- The agent loop is a roughly 200-line ReAct harness that can read / edit / runtests and talk to any OpenAI-compatible endpoint.
The post frames this as a model-agnostic, practical way to compare coding agents on the same debugging task.
Related event: Open-Source Models Fix Real-World Bugs in ReAct Framework Test(2 posts)→
More from coding & agent
- WanGP adds one-click AMD GPU support for Tencent's Hy-Nomas world model, runs on 8GB VRAM — cocktailpeanut · 2026-10-27
- He benchmarks new models by having them build their own copilot — $28 of compute — bucolucas · 2026-10-27
- Founder generates 46 app promo videos in 4 days with Claude, skipping $11,500 in UGC fees — PrajwalTomar_ · 2026-10-27
- Should agents be allowed to change plans mid-task? Reddit debates the drift boundary — wistfulcracker84 · 2026-10-27
- HeyGen + Canva MCP turns slide speaker notes into an avatar presentation video — HeyGen · 2026-10-27
- Local beats cloud: Qwen 3.8 FN handles private student data as well as frontier models — dr_lm · 2026-10-27