16-model eval finds Sonnet 5 hedges most, landing in ambiguous zone 41.3% of the time
AlexKim · x · 2026-09-19
A follow-up finding from the same 16-model eval: the metric the author almost skipped turned out most discriminating — how often each model places its answer in the ambiguous 0.35-0.65 middle:
- Sonnet 5: 41.3%
- Fable 5.1: 36.7%
- Jev: 34.7%
- Opus 5: 23.3%
Then a cliff — Opus 5 hedges far less than the rest.
More from Models
- Fable 5.5 delayed as Anthropic reportedly bets OpenAI's Astra 6.2 won't beat it — haider1 · 2026-11-04
- Community asks Moonshot when Kimi K3.1 model weights will drop — bgmshana · 2026-11-04
- Meta's Muse Spark Open license counts distilled models as derivatives — aidenclarke_12 · 2026-11-04
- Tencent Hy4 trails GPT-6.1 on hard tests as Kimi K3.1 Pro beats it on two benchmarks — heyshrutimishra · 2026-11-04
- Tencent's Hy4 agent self-trained a smaller model that beat Tencent's own baseline — heyshrutimishra · 2026-11-04
- Hy4 tops open models in finance eval at 3.04, hallucination rate cut to 5.45% — heyshrutimishra · 2026-11-04