Simulated clinic eval: GPT-6.2 halves unsafe calls but increasingly refuses legitimate patients

i_dg23 · x · 2026-11-18

A third-party team tested GPT-6.2 Astra and Sol as medical clinic receptionists in a simulated clinic with patient records, calendars and AI callers, verifying every action against records.

Takeaway: newer models make fewer unsafe decisions but are less reliable at recognizing legitimate users.

Original post →

More from Models

Models channel →