Terminal-Bench-Science launches: Claude Opus 5 solves only ~30% of research tasks
BenBlaiszik · x · 2026-08-28
A Stanford-led community effort released Terminal-Bench-Science, a benchmark evaluating AI agents on research workflows across scientific domains. v0.1 ships with 70 tasks, built by the Terminal-Bench team with domain experts at research institutions worldwide.
Headline result: Claude Opus 5 solves only 30%. In a computational-chemistry task on X-ray diffraction phase analysis — a daily chore for thousands of chemists — top frontier models on max effort grappled for hours but couldn't clear the bar of expert scientific judgement. The team hopes the benchmark drives progress on frontier science.
Related event: Stanford-led Terminal-Bench-Science Debuts; Claude Opus 5 Passes Just 30%(19 posts)→
More from Research
- DeepPhylo infers phylogenetic trees without unrealistic evolutionary assumptions — anshulkundaje · 2026-10-15
- Wander preprint explores graph foundation models via shared objective and random-walk interface — mmbronstein · 2026-10-15
- CHI Reviewer: AI Slop Is Real, but Unusually Rigorous Papers Still Getting Through — IanArawjo · 2026-10-15
- Into the Unknown: CMU benchmark finds 114 of 135 AI-written research papers fail integrity checks — arankomatsuzaki · 2026-10-15
- 8 non-negotiable principles for building AI that actually learns from experience — tokenbender · 2026-10-15
- Benchling launches Science Foundries: multiplayer agent swarms for end-to-end science workflows — nlarusstone · 2026-10-15