Terminal-Bench 4.0 Released with Resource Calibration and Task Fixes
sanmikoyejo · x · 2026-08-30
A version update has been pushed to the Terminal-Bench dataset and leaderboard. Terminal-Bench 4.0 calibrates task resources (time, CPU, memory), implements task fixes, and removes saturated tasks.
Related event: Terminal-Bench 4.0 Released: Opus 5 Leads, GLM 5.3 Top Open-Source Model(14 posts)→
More from Research
- WorldMemArena Accepted at NeurIPS: Memory Storage ≠ Memory Use — xwang_lk · 2026-10-16
- Mech Interp Veteran Rethinks Alignment, Misgeneralization, CoT Oversight — akbirthko · 2026-10-16
- WEDGE paper generates training environments conditioned on navigation agent failures — _akhaliq · 2026-10-16
- RExBench: best coding agent completes only 33% of autonomous research extensions — najoungkim · 2026-10-16
- Google's CLASHarness benchmarks multi-agent conflicts in computer use, finds frontier VLMs struggle — google · 2026-10-16
- Tsinghua team proves vanilla flow-matching sampling can't exceed constant-depth expressive power — SQZ · 2026-10-16