Muse Wonder scores ~42% on senior engineer benchmark vs Sol 6.1's 71%
danshipper · x · 2026-10-13
Dan Shipper reports Muse Wonder performed poorly on his senior engineer benchmark, which asks a model to rewrite a vibe-coded slop codebase from scratch: muse-wonder-1.0 scored 42% (20/48 checks) vs 71% (34/48) for Sol 6.1 — and Sol 6.1 isn't even the top-scoring model. Screenshots show both models' Codex CLI high-effort deliveries of a greenfield collaboration-core rewrite, with Muse passing notably fewer checks.
Related event: Muse Wonder Scores 42% on Senior Engineer Benchmark, Far Behind Sol 6.1(2 posts)→
More from coding & agent
- Running tens of millions of experiments on useless programs with LLMs — bushibuilds · 2026-10-13
- Xiryn: Open-Source Personal Agent with Docker Sandboxes and Telegram Control — Scobleizer · 2026-10-13
- Witness Tracks Everything You Do and See So Your Agents Always Have Context — Scobleizer · 2026-10-13
- MecAgent 2.0 launches as its maker claims 'CAD is about to get solved' — Scobleizer · 2026-10-13
- Dev finds ~25% of AI-generated code introduces regressions in .NET 8+ — lucasmeijer · 2026-10-13
- Investor says coding agents left most software firms badly overstaffed, cut now or be disrupted — doodlestein · 2026-10-13