Anthropic’s Claude Opus 5 system card shows gains over Mythos 5 on internal evals
tokenbender · x · 2026-07-25
Anthropic’s Claude Opus 5 system card is out, and the posted table suggests it outperforms Claude Mythos 5 on several internal research tasks, while still falling short on some thresholds.
The screenshot shows results across tasks such as:
- Kernel task: 449.46× vs 430.93× for Claude Mythos 5
- Time series forecasting: 5.68 vs 4.51 MSE on the hard variant
- LLM training (easy): 68.54× vs 69.61×
- LLM training (hard): 14.19× vs 8.36×
- Quadruped RL: 31.3 vs 29.55
- Novel compiler: 80.91% pass rate vs 85.3%
The card also notes that recent models now exceed the old rule-out thresholds on all but two tasks in Anthropic’s internal suite, so the risk analysis no longer relies on those automated evaluations.
Related event: Anthropic Releases Claude Opus 5: SOTA Performance at Half the Price(128 posts)→
More from Models
- Benchmark scores drop from 89% to 19% on new evals — how benchmaxxing breaks leaderboard trust — airesearch12 · 2026-09-11
- ChatGPT tells user their question is too hard and to 'accept dumber answers' — phido3000 · 2026-09-11
- Developer Building a Unified Leaderboard of All Model Benchmark Scores — airesearch12 · 2026-09-11
- Rumor claims Kimi faked performance by serving Claude; DeepSeek new model surprises in evals — realsohamparekh · 2026-09-11
- GPT-5.6 writes well but is instantly forgettable, user complains — BasedRaddka · 2026-09-11
- Opus Refuses Protein Research Codebase Over 'Safety' Concerns, Dev Considers Rolling His Own — josephdviviano · 2026-09-11