105 planted bugs in real repos: Meta's Muse Spark 1.3 ties Fable 5.1, joins the frontier
PawelHuryn · x · 2026-09-14
Pawel Huryn ran an original harness over two real code repos with 105 planted bugs, asking frontier models to find and fix what they could.
Results:
- Muse Spark 1.3 (max): 33
- Fable 5.1 (high): 33
- Grok 4.6 (xhigh): 27
- Opus 5 (max): 27
- Muse Spark 1.3 (high): 19
The takeaway: Meta has joined the frontier. Scale AI CEO Alexandr Wang amplified the result, saying muse code + muse spark 1.3 max is "really good at real-world software engineering." More effort levels are being dropped in the thread every 1.5 hours.
Related event: Bug Hunt Bench: Muse Spark 1.3 Ties Fable 5.1 for the Top Spot(6 posts)→
More from coding & agent
- GitHub Copilot app is building richer dashboard widgets for personalized data views — mariorod1 · 2026-10-31
- Todoist's self-healing agent auto-fixes 1 in 5 Sentry issues and opens PRs — zeeg · 2026-10-31
- Dev's Multica 1.0 build log: 432M tokens, 89 agent runs, just $183 — jiayuan_jy · 2026-10-31
- Stardock's QA now runs agents that play the game and file reports — draginol · 2026-10-31
- Limma MCP structures unstructured data end-to-end so agents never miss a detail — FlimsyIngenuity7248 · 2026-10-31
- Agent audit metric: can you name which tests ran and files changed without reading its summary? — ronbodkin · 2026-10-31