Tencent Hunyuan Hy4 Fixes 17 Bugs for $3.13 in Real-Repo Blind Test
Developer Pawel Huryn blind-tested Tencent Hunyuan Hy4 (preview) on Bug Hunt Bench: 105 hard bugs were pre-seeded across 2 real code repositories, with the tester unaware of the answers, making the setup closer to real-world engineering. Hy4 in default settings fixed 17 bugs for $3.13; by comparison, Fable 5 (max) fixed 29 for $104.49, with Opus 5 also included. Huryn concludes Hy4 sits at the cost-efficiency frontier.
Confirmed
- Test design: 2 real repositories, 105 pre-seeded hard bugs, blind evaluation, published by Pawel Huryn.
- Hy4 (preview) fixed 17/105 in default settings at $3.13.
- Fable 5 (max) fixed 29/105 at $104.49; Opus 5 was also compared.
- Bug Hunt Bench added a per-model bug Coverage view with filtering and PNG export.
Why it matters
- The test shows usable bug-fixing capability at extremely low cost, valuable for budget-sensitive engineering teams.
- The coverage view makes model capability complementarity visible, increasing the leaderboard's practical value.
Unconfirmed
- All posts derive from Huryn's own evaluation; exact scripts and model version details should be verified against the original leaderboard.
2026-08-28 ~ 2026-08-28 · 4 related posts
Primary sources
- [source] Tencent Hunyuan Hy4 Fixes 17 Bugs for Just $3.13 in Real-World Test — PawelHuryn · 2026-08-28
- Testing Tencent Hunyuan Hy4 preview: 17/105 bugs fixed for just $3.13 — PawelHuryn · 2026-08-28
- [source] Bug Hunt Bench Adds Per-Model Bug Coverage View; Hunyuan Sits on the Price-Performance Frontier — PawelHuryn · 2026-08-28
1 near-duplicate retellings: RiqueRostirolla