OpenAI models sweep medical QA accuracy top spots, GPT-6.1 Sol hits 96.7% on MLCR-AA
ArtificialAnlys · x · 2026-10-21
On Artificial Analysis' MLCR-AA leaderboard, OpenAI models hold the top accuracy scores, led by GPT-6.1 Sol (max) at 96.7% and GPT-6 Astra (max) at 95.6%; the best non-OpenAI model is Qwen3.8 2.4T A95B at 76.1%.
Accuracy means no claim contradicts the medical record, from dates and measurements to finding severity. But OpenAI models often miss key points the question asks for — GPT-6.1 Sol (max) is complete on only 40.0% of questions.
More from Models
- Recursive AI ships Flint, a 40B-A2.5B MoE claimed to match Qwen3.6-27B, weights on Hugging Face — ChengleiSi · 2026-10-22
- DeepSeek ships V4.1-Flash-1017, now the #1 open model on RSI-Inference Bench — scaling01 · 2026-10-22
- OpenAI's Cybersecurity Guardrails Block a Dev From Auditing His Own Patched Server — Next_Technology6361 · 2026-10-22
- TPN-006 hits Hugging Face: 7.7GB compressed model beats its 17GB Mistral teacher — markjeffrey · 2026-10-22
- Kimi K3.1's latest checkpoint draws 49k-token SVG portrait zero-shot in 22 minutes — lyraxana · 2026-10-22
- MiniMax launches M3.1 Flash at 1/3 the cost and 3x the speed of M3, weights out Oct 23 — MiniMax_AI · 2026-10-22