Claude Opus 5 flips 30 times on a probability problem before settling on one answer
scaling01 · x · 2026-07-25
A benchmark screenshot shows Claude Opus 5 struggling with a probability question and repeatedly changing its answer before settling on one.
According to the caption, the model:
- identified two defensible answers
- changed its mind 30 times
- finally committed to one answer
- scored 5/5 for distress
The post is basically a snapshot of uncertainty and instability in model reasoning, not a product announcement.
Related event: Claude Opus 5 Shows Erratic Behavior in Probability Tests(3 posts)→
More from Models
- OpenAI rated Astra 'Critical' for cyber capabilities — and admits it's harder to monitor — theguywhobuilds · 2026-09-11
- TestingCatalog's Daily AI Brief adds email editions, dishing Meta Muse and GPT-Live-1 rumors — testingcatalog · 2026-09-11
- ChatGPT monthly active users top 1.06 billion in August, fourth straight record month — FinanceYF5 · 2026-09-11
- PuzzleMask: Plain-Prose Attack Bypasses All 4 Tested LLM Gatekeepers at 100% — TechNadu · 2026-09-11
- OpenAI Codex may issue another usage reset this weekend, says Codex lead resets happen — umesh_ai · 2026-09-11
- OpenAI Reportedly Pointing Its Navier–Stokes Model at Riemann and P vs NP — 141_1337 · 2026-09-11