LLMs still have a confidence calibration problem
danshipper · x · 2026-07-20
The post argues that LLMs often have a serious self-confidence problem: when asked how likely a life-changing event is, they may answer without giving a realistic sense of uncertainty.
The author points to a specific example presented as “a story in two photos,” using it to suggest that models still struggle with calibrated confidence rather than just raw capability.
More from Models
- AI search APIs ranked: top 12 within 7 points, yet prices differ nearly 7x — FinanceYF5 · 2026-10-26
- OpenAI Dots coming to EU/EEA and UK in a few weeks, slides confirm — testingcatalog · 2026-10-26
- OpenAI Dots demoed live as EU launch speculated, Codex adoption in Germany revealed — testingcatalog · 2026-10-26
- "Abliterated models just have brain damage" — community pushes back on unaligned model hype — dhadfieldmenell · 2026-10-26
- dair-ai publishes primer on Cloudflare's Clairic System One extraction model — dair_ai · 2026-10-26
- MiniMax M3.1 Flash free window on 0G ends early, shifts to paid pricing — MiniMax_AI · 2026-10-26