Grok 4.6 tops MedAgentBench, edging out GPT-5.6 Sol on agentic clinical EHR tasks
elonmusk · x · 2026-08-18
Third-party evaluator MedicalSphereAI measured Grok 4.6 at 95.9% pass@1 (average of 3 runs) on MedAgentBench, a benchmark where the model acts as an autonomous agent in a simulated EHR, calling FHIR APIs across 10 clinical task types. That beats prior leader GPT-5.6 Sol (94.7%) and improves on Grok 4.5 by 2.5 points, with remarkably consistent runs (95.3%–96.3%). Musk shared the result.
Related event: Grok 4.6 Tops MedAgentBench Clinical Agent Benchmark(2 posts)→
More from Models
- ChatGPT outage logs users out across all mobile apps as OpenAI investigates — JeremyNguyenPhD · 2026-10-16
- Gemini 4 Argon rolls out on Pro plans with a separate weekly usage limit — vv_dog · 2026-10-16
- Meta open-sources Muse Spark Open agent model with day-0 TPU support in SGLang — BanghuaZ · 2026-10-16
- Saying "load-bearing" in your prompt makes Opus 5.5 stop holding back — zacharynado · 2026-10-16
- Americans get their Claude accounts banned while on business trips in China — dotey · 2026-10-16
- I priced every Grok Bot call: $20 to $200 plan in 5 days, long jobs eat 52% — jonathanmalkin · 2026-10-16