LLM Denial Explanations Cite True Reasons Yet Leave Applicants Stuck: New Paper

alex_verem · x · 2026-11-18

Highlights arXiv paper "Right Reason, Wrong Advice: Evaluating Recourse in LLM Explanations of Denied Requests". When multiple rules independently deny a request, an LLM explanation can name a true reason while the applicant still gets denied after fixing it — the paper calls the missing property recourse validity. A hitting-set argument predicts from the policy alone when a correct reason fails, and the authors argue eligibility explanations should be built from the decision function and judged by whether acting on them works.

This is the shorter of two posts on the same paper in this batch; notification labels go to the fuller one.

Related event: 141,750 Explanations Tested: LLM Denial Reasons Are True but Fixes Still Fail(2 posts)→

Original post →

More from Safety

Safety channel →