Using LLM confidence scoring is a bad idea (HN discussion)
jimauthors · hn · 2026-10-21
An HN thread discusses a blog post arguing that asking an LLM to score its own confidence is unreliable: the model's self-reported confidence systematically diverges from its actual correctness, making it a poor signal for routing, filtering, or risk control in agent pipelines.
Commenters dig into why self-reported confidence breaks down and what to use instead, such as sampling consistency and external verifiers. Recommended for anyone building agent workflows that rely on model self-assessment scores.
More from Research
- RFD4-Proteina's 'underrated' docs detail partial diffusion for protein redesign — AllThingsApx · 2026-10-23
- MPI-Sec PhD Thesis on Vulnerability Detection Benchmarks Includes Pre-LLM Classic "Top Score on the Wrong Exam" — mboehme_ · 2026-10-23
- LiveNerf's 29-day data finds no nerfing of Claude Opus 5.5 — TheOnlyVibemaster · 2026-10-23
- New paper makes 9 falsifiable predictions toward a major AI-enabled terror attack by 2027-2028 — StephenLCasper · 2026-10-23
- HumanoidPose recovers humanoid robots' full-body joint states from RGB video alone — cholz · 2026-10-23
- Sophont's Holon-S1 predicts genes and biomarkers from routine pathology slides — iScienceLuvr · 2026-10-23