Hospital-bench tests agents on hospital ops: GPT-6.2 Astra leads at 62.4%, safety failures widespread

omarsar0 · x · 2026-11-21

zavoai released Hospital-bench, a simulation benchmark testing whether AI agents can handle hospital administrative work — insurance verification, prior authorizations, claims, billing and records requests — inside a simulated health system with 13 apps and 131 tools. 20 models ran 48 tasks each.

Key results:

Takeaway: reliably and safely completing complex multi-system workflows remains a major unsolved challenge for AI agents.

Original post →

More from coding & agent

coding & agent channel →