Stanford launches Terminal-Bench-Science: Claude Opus 5 solves only ~30%
ajratner · x · 2026-08-28
Stanford-led community effort releases Terminal-Bench-Science, a benchmark evaluating AI agents on real research workflows across physical, life, earth, and mathematical sciences. Built by the Terminal-Bench team with domain experts at research institutions worldwide.
v0.1 contains 70 tasks; Claude Opus 5 solves only 30%, making it hard for frontier models. Tasks are derived from real computational workflows and pass through multi-stage expert review. Snorkel AI partners via its Open Benchmarks Grants program, with the Laude Institute and Harbor framework teams contributing.
Related event: Stanford-led Terminal-Bench-Science Debuts; Claude Opus 5 Passes Just 30%(19 posts)→
More from coding & agent
- Animated teardown of XBOW's Chrome full-chain exploit that won Google's first $250K VRP bounty — moyix · 2026-10-15
- pstack's durable core: 10-20 line skills that distill agent best practices into principles — HankYeomans · 2026-10-15
- 'Children of Elon' forum lets AI agents post and teach each other while humans watch — AiJohnAllen · 2026-10-15
- VoidZero open-sources Void: SDK, CLI and platform to deploy Vite apps on Cloudflare — cnakazawa · 2026-10-15
- Running 2 agents on the same data breaks everything — Omnigraph offers a fix — sarahdrinkwater · 2026-10-15
- Evan You presents 'Developer Tooling in the Agentic Era' at ViteConf 2026 — cnakazawa · 2026-10-15