Grok 4.6 Tops Rare Disease Diagnosis, DeepSeek v4-pro Underperforms
danielmckinn0n · x · 2026-08-14
The latest RareBench results have sparked community discussion:
- xAI's Grok 4.6 delivered a surprising performance, beating Anthropic's Claude Opus 5 to take the crown in pediatric rare disease diagnosis, at only 1/3 of the cost.
- DeepSeek v4-pro-0813 underperformed significantly, even losing to v4-flash. The author suspects DeepSeek might not have switched their model endpoint correctly upon release.
- Zhipu's GLM5.2 also underperformed expectations; the author noted that for coding use-cases, Kimi K3 is substantially stronger than GLM.
Related event: Grok 4.6 Tops Rare Disease Diagnosis Bench, DeepSeek Stumbles(2 posts)→
More from Models
- Unverified claim: Apple and Meta's 816B-parameter Muse Spark Open runs on two Mac Studios — TansuYegen · 2026-10-16
- Gemini 4 model card: model eliminated months of trial-and-error on bioweapons research — Puzzleheaded-King584 · 2026-10-16
- Every AI picks 7: Anthropic engineer's rule for escaping model taste convergence — rubenhassid · 2026-10-16
- Brain teaser: strip all attention, MLP and embedding matrices from a Llama 3 — how many trainable params remain? — Sauers_ · 2026-10-16
- Lean v4.35.0 ships verified kernels — one written and proven consistent by Claude — geoffreyirving · 2026-10-16
- One flagged seat froze an entire Claude team org — founders share backup plans — RexDouglass · 2026-10-16