Testing Tencent Hunyuan Hy4 preview: 17/105 bugs fixed for just $3.13
PawelHuryn · x · 2026-08-28
The author planted 105 hard bugs across 2 real repos and asked models to find and fix them—labs don't know the answer key, making it closer to real-world use.
Results:
- Fable 5 (max): 29/105 for $104.49
- Opus 5 (max): 27/105 for $51.33
- Qwen3.8-Max (xhigh): 18/105 for $31.19
- Hy4 preview (default): 17/105 for just $3.13
- Gemini 3.7 Flash (high): 16/105 for $6.36
Verdict: not a breakthrough, but Hy4 sits on the price-performance Pareto frontier with open weights—a solid everyday coding partner.
Related event: Tencent Hunyuan Hy4 Fixes 17 Bugs for Just $3 in Benchmark(4 posts)→
More from coding & agent
- Web Draw: MCP server reads pages as text instead of screenshots — ahstanin · 2026-08-28
- If your MCP sucks, it's probably because you're doing it wrong — otothea · 2026-08-28
- Understanding the difference between AI Models and Agentic Harness — _jaydeepkarale · 2026-08-28
- AssemblyAI breaks down voice agent architecture — AssemblyAI · 2026-08-28
- Client wanted an AI agent, but only needed simple context memory — Radiant-Scarcity2333 · 2026-08-28
- How to trust AI agent changes in a disposable Docker environment? — pineconeseedling · 2026-08-28