DART: ambiguity steering vectors improve LLM confidence calibration across 7 models

dhadfieldmenell · x · 2026-11-11

LLMs are highly overconfident even when they don't know something. New work led by Themistoklis Nikolas proposes DART, which derives ambiguity steering vectors via interpretability and uses them to guide fine-tuning — improving confidence calibration across 7 models while preserving accuracy. The vectors can also encode these improvements directly into model weights.

Related event: DART uses ambiguity steering vectors to curb LLM overconfidence(2 posts)→

Original post →

More from Research

Research channel →