InclusionMed launches open medical AI benchmark atlas after auditing 388 candidates
The InclusionMed Collaboration · hf · 2026-11-17
InclusionMed is an open evaluation initiative auditing and reproducing medical AI benchmarks across healthcare roles and AI capabilities. From 388 candidates, structured audits and independent reproduction selected four public benchmarks, plus the private diagnostic-reasoning benchmark InclusionMed-DxFiles, forming a five-benchmark Atlas. Findings show model rankings and inference costs vary by context, motivating broader context-specific evaluation.
More from Research
- Tencent Hunyuan's Accelerate Bench tests 16 coding agents on 32 CPU optimization tasks — Tencent-Hunyuan · 2026-11-17
- SWE-CoWork: coding agents pass 63% of tests but complete fewer than 8% of tasks — Tokenwave-AI · 2026-11-17
- Centered Ablation: a closed-form fix that boosts refusal-direction ablation by up to 46 points — knoveleng · 2026-11-17
- DominoBench: VLMs can't reliably predict physical outcomes from still images — UniversityofSouthernCalifornia · 2026-11-17
- RAPO: reflection anchors curb visual information decay in long-chain multimodal reasoning — Xuan Gong · 2026-11-17
- RL agent beats Pokémon Red with a <10M-parameter policy, 60,500x smaller than DeepSeek-V3 — Bam4d · 2026-11-17