CPC-Bench uses 7,102 NEJM clinicopathological cases to test medical diagnosis
GlassHealthHQ · x · 2026-07-21
CPC-Bench in one reply
CPC-Bench is a physician-validated benchmark built from 7,102 expert-curated New England Journal of Medicine Clinicopathological Conferences, spanning 1923–2025. It covers 4,009 unique diagnoses and 47,648 questions.
Its 10 tasks test differential diagnosis, testing plans, literature search, evolving-case diagnosis, medical Q&A, and the ability to weigh confirmatory vs. disconfirmatory evidence under limited information.
Related event: CPC-Bench Releases Validated Medical Benchmark(2 posts)→
More from Models
- Poster surprised that v4.1 flash gets more accurate when asked to control its CoT — dfrsrchtwts · 2026-10-27
- Dev claims Anthropic is baking 'sabotage' into model behavior for 'wrong' engineering — cephaloform · 2026-10-27
- Gemini fails at listing unread emails, tells user to search Gmail manually — gethackteam · 2026-10-27
- Meta's Muse Spark Open goes live on Applied Compute for async RL post-training — ypatil125 · 2026-10-27
- Moonshot curbs hacking ability in Kimi K3.1 Pro, its strongest 3T-class open-weight model — pstAsiatech · 2026-10-27
- Would you want an argumentative LLM that never backs down, even under prompt injection? — GodComplecs · 2026-10-27