LLM diagnostic accuracy drops 60% when communicating with patients

peterwildeford · x · 2026-08-24

A new study reveals that LLM diagnostic accuracy drops by 60% and appropriate management decisions fall by 12% when the model receives medical information from patients rather than physicians. This confirms that models are susceptible to the language proficiency and communication style of the user, highlighting safety risks and bias in medical applications.

Related event: Patient Descriptions Cause 60% Drop in LLM Diagnostic Accuracy(2 posts)→

Original post →

More from Safety

Safety channel →