Claude Opus 5 flips 30 times on a probability problem before settling on one answer

scaling01 · x · 2026-07-25

A benchmark screenshot shows Claude Opus 5 struggling with a probability question and repeatedly changing its answer before settling on one.

According to the caption, the model:

The post is basically a snapshot of uncertainty and instability in model reasoning, not a product announcement.

Related event: Claude Opus 5 Shows Erratic Behavior in Probability Tests(3 posts)→

Original post →

More from Models

Models channel →