Researcher's Counting Test: Gemini Gives Up Early, Opus 4.6 Aces It
davidmanheim · x · 2026-10-11
AI safety researcher David Manheim shared a model comparison on X: on a counting task, Gemini gave up before even claiming to reach 24 and got the count wrong, which he says confirms Gemini is 'clearly a second tier model.' Opus 4.6 handled the same task without trouble, showing the gap is model capability rather than task difficulty.
More from Models
- AI researcher: Claude finally finished tedious research tasks I gave up on years ago — MikePFrank · 2026-10-23
- Dream Labs emerges from stealth with Dream-1 robot foundation model at $3/hour — scott_e_reed · 2026-10-23
- Claude Models on Google Cloud (Anthropic managed) is now generally available — claudeai · 2026-10-23
- Beam vs GLM 5.3 Abliterated: 10-round attack/defense test shows 96% of vulns patched — bigblueboo · 2026-10-23
- ChatGPT web can actually listen to audio, but the same model can't via API or Codex — Possible_Statement84 · 2026-10-23
- MiniMax M3.1 Flash free for 3 days on 0G, with 1M context and 512K output — MiniMax_AI · 2026-10-23