70 tasks selected from 920 proposals for benchmark
sanmikoyejo · x · 2026-08-28
Tasks are contributed by researchers worldwide through an open review process involving three layers: a domain reviewer, a technical reviewer, and a bar raiser. Out of 920 proposals, only 70 tasks made it into Terminal-Bench-Science 0.1. Accepted tasks must be scientifically grounded, objectively verifiable, and genuinely challenging for frontier agents.
Related event: Stanford-led Terminal-Bench-Science Debuts; Claude Opus 5 Passes Just 30%(19 posts)→
More from Research
- OpenAI gives $5M to Simons Foundation's $15M push to help mathematicians navigate AI-era results — OpenAI · 2026-10-15
- DeepPhylo infers phylogenetic trees without unrealistic evolutionary assumptions — anshulkundaje · 2026-10-15
- Wander preprint explores graph foundation models via shared objective and random-walk interface — mmbronstein · 2026-10-15
- CHI Reviewer: AI Slop Is Real, but Unusually Rigorous Papers Still Getting Through — IanArawjo · 2026-10-15
- Into the Unknown: CMU benchmark finds 114 of 135 AI-written research papers fail integrity checks — arankomatsuzaki · 2026-10-15
- Benchling launches Science Foundries: multiplayer agent swarms for end-to-end science workflows — nlarusstone · 2026-10-15