ClinOpsBench: 15 AI agents tested on 4-month simulated clinical trial oversight
ycombinator · x · 2026-10-17
Panoptive released ClinOpsBench: Trial Oversight v1.0, the first in a series of agent evaluation environments built from real customer deployments for long-horizon clinical development work. Fifteen AI agents ran oversight on an expert-curated simulated clinical trial over four months. Key finding: the strongest frontier agents caught most critical issues, but none met the complete oversight standard. The benchmark includes 45 runs across 15 models, with published results, source evidence, and representative trajectories; private held-out environments are available on request.
More from coding & agent
- Zach Lloyd on the 'software factory': engineering is becoming factory engineering — vikvang1 · 2026-10-17
- "A Great Model with a Bad Harness Loses": Complete Guide to Harness Engineering — aakashgupta · 2026-10-17
- Ex-Chrome lead Addy Osmani: a decent model with a great harness beats a great model — aakashgupta · 2026-10-17
- Dev uses Claude to ban millions of IPs by ASN, stopping a 0.5Tbps-scale attack — basedjensen · 2026-10-17
- GLM 5.3 Prompt for API Security Testing Sparks Debate — MicahBerkley · 2026-10-17
- RUC open-sources EvoOntology: self-evolving ontology layer lifts data agents by up to 26.7 points — udmrzn · 2026-10-17