LLM Denial Explanations Cite True Reasons Yet Leave Applicants Stuck: New Paper
alex_verem · x · 2026-11-18
Highlights arXiv paper "Right Reason, Wrong Advice: Evaluating Recourse in LLM Explanations of Denied Requests". When multiple rules independently deny a request, an LLM explanation can name a true reason while the applicant still gets denied after fixing it — the paper calls the missing property recourse validity. A hitting-set argument predicts from the policy alone when a correct reason fails, and the authors argue eligibility explanations should be built from the decision function and judged by whether acting on them works.
This is the shorter of two posts on the same paper in this batch; notification labels go to the fuller one.
More from Safety
- Are system failures really at record highs? Data says high but not unprecedented — emollick · 2026-11-18
- 141,750 Explanations Tested: LLM Denial Reasons Are True but Fixes Still Fail — alex_verem · 2026-11-18
- Microsoft Denies AI Caused the Outlook Outage: July Fix Bug Plus Heavy Load to Blame — Optimum1997 · 2026-11-18
- AI-powered attacks land in four days: your patch window is no longer a decade — ccerrato147 · 2026-11-18
- Chinese phishing service Jieyou adds AI bot: fake login pages via plain language — ccerrato147 · 2026-11-18
- Google caught a contractor building a 100,000-fake-account platform run by AI — ccerrato147 · 2026-11-18