Even Haiku 4.5 Passes This Reasoning Test, as Opus 4.6 Counters Model-Gap Claims
davidmanheim · x · 2026-10-11
In a discussion about a reasoning puzzle, David Manheim notes you need to make the task quite easy for decent models to fail: Gemini isn't half a step behind the frontier — Opus 4.6 handled it without trouble — and even Haiku 4.5 counted correctly despite not recognizing what the numbers looked like.
The exchange is effectively a hands-on rebuttal to claims that a particular model lags in reasoning: multiple frontier and lightweight models perform consistently, suggesting observed failures stem from perception and prompting details rather than a genuine capability gap.
More from Models
- AI researcher: Claude finally finished tedious research tasks I gave up on years ago — MikePFrank · 2026-10-23
- Dream Labs emerges from stealth with Dream-1 robot foundation model at $3/hour — scott_e_reed · 2026-10-23
- Claude Models on Google Cloud (Anthropic managed) is now generally available — claudeai · 2026-10-23
- Beam vs GLM 5.3 Abliterated: 10-round attack/defense test shows 96% of vulns patched — bigblueboo · 2026-10-23
- ChatGPT web can actually listen to audio, but the same model can't via API or Codex — Possible_Statement84 · 2026-10-23
- MiniMax M3.1 Flash free for 3 days on 0G, with 1M context and 512K output — MiniMax_AI · 2026-10-23