Theo benchmarks Opus 5.5, GPT-6.1 Sol and Muse Wonder Full on a bug fix
shadcn · x · 2026-10-13
Theo (retweeted with approval by shadcn) ran the same bug-fix task across three models:
- Opus 5.5: found the root cause and filed a PR.
- GPT-6.1 Sol: asked a question, crashed on the async question tool interrupt, then still found the bug, fixed it, wrote 300 lines of tests, and explained it in impenetrable prose.
- Muse Wonder Full: found a small PR someone else had filed and suggested "you should probably merge this instead" — which Theo says he quite likes.
A light but genuinely informative coding-model behavior comparison.
More from coding & agent
- Daniel Jeffries: only ~2% can actually use AI agents, mass adoption is 10-20 years away — Dan_Jeffries1 · 2026-10-13
- Fully local AI short film mimics Wes Anderson style with a detailed open pipeline — Mist3r-Robot · 2026-10-13
- Controlling his Mac's terminal from a phone via t3 code beta while waiting at speech therapy — NERDDISCO · 2026-10-13
- LLM cache verifier drift: reject-only calibration tripled error rate; 5% audits fix it — Reasonable_Royal_621 · 2026-10-13
- A style guide for making Claude-like models write normally, and its linguistic traps — gleech · 2026-10-13
- Open-source desktop agent dodaios runs local Qwen models via ollama — and shows where 16GB models fail — InternationalGap3698 · 2026-10-13