Muse Spark 1.3 Tested: xhigh Costs 50% More, 13% Slower, Fixes One Extra Bug
PawelHuryn · x · 2026-09-13
Developer PawelHuryn reports benchmark results across reasoning-effort tiers for Muse Spark 1.3: the xhigh tier scores 20, costs 50% more and runs 13% slower than high, yet fixes only one more bug. The author says the jump to max buys the biggest gain, with medium effort up next.
In an FAQ, the author notes these are not random bugs but hard, real issues frontier models struggled with in early 2026; blind judges from a different model family verify solutions and their calibration was confirmed; unplanted bugs aren't counted, and OpenAI models 'bugmax' by reporting many real but irrelevant issues, which often complicates the solution when fixed.
Related event: Bug Hunt Bench: Muse Spark 1.3 Ties Fable 5.1 for the Top Spot(6 posts)→
More from Models
- Perplexity early evals: Gemini 4 Carbon tops WANDR benchmark for long-form research — AravSrinivas · 2026-10-31
- DeepSeek's silent downtime upgrade caught by the pelican bicycle test — teortaxesTex · 2026-10-31
- ARC Prize 2026 closes in 3 days as Yi-Chia Chen tops ARC-AGI-3 at 75.56% — GregKamradt · 2026-10-31
- Fable 5.5 Max stuns with gorgeous SVG of a pelican riding a bicycle, headed to Claude Code — ChrisGPT · 2026-10-31
- OpenAI reportedly to train on users' Daybreak sessions with no opt-out — dyn___ · 2026-10-31
- NVIDIA Nemotron 3.5 scales LLM self-verification, +9-10 points on agentic benchmarks — sarahcat21 · 2026-10-31