Bug Hunt Bench grades frontier coding models on planted bugs; Kimi's CLI cost 2.9x Claude Code
PawelHuryn · x · 2026-10-24
Pawel Huryn launched Bug Hunt Bench, a blind-graded leaderboard testing frontier coding models on 105 real planted bugs with one prompt per repo. He questions why the K3.1 Pro launch evaluated coding benchmarks inside Claude Code, noting that in his tests Kimi K3 on Moonshot's own CLI cost 2.9x more than Claude Code. The board supports score-vs-cost/time/turns views, with all data open-sourced on GitHub.
More from coding & agent
- OpenAI DevEx lead to keynote BoxWorks Dev Summit on tools, memory and agentic work — OpenAIDevs · 2026-10-24
- Developer slams Kimi coding plan: 5-hour quota gone in under 10 minutes — jasonkneen · 2026-10-24
- Terminal-Bench 4.0 chart: Kimi K3.1 Pro tops at ~65% for ~$4-5 per task, beating Claude on cost — zainhas · 2026-10-24
- Dev builds a bookmarklet that clones your clipboard into a reusable paste bookmark — JnBrymn · 2026-10-24
- ZXFLASH compiles ZX Spectrum BASIC straight to Flash SWF bytecode running in Ruffle — danbri · 2026-10-24
- Enclave opens autonomous security agent fleet to everyone, launches Threat Feed vulnerability feed — BenBajarin · 2026-10-24