New paper: LLMs falter at probabilistic belief updating, not action optimization

Dr_Atoosa · x · 2026-10-23

A new paper from Jessica Hullman's group examines why LLMs make bad calls as decision assistants (risk estimation, treatment recommendation): did the model fail to arrive at correct beliefs, or fail to optimize actions under the right utility? Findings and independent replication by xuanalogue suggest LLMs are worse at probabilistic belief updating than at optimizing under correct, usually deterministic, beliefs.

Related event: Hullman Team Decomposes LLM Decision Errors into Belief Loss and Optimization Residual(11 posts)→

Original post →

More from Research

Research channel →