Terminal-Bench 4.0 released: calibrates resources, fixes tasks, removes saturation
giansegato · x · 2026-08-29
The Terminal-Bench dataset and leaderboard have been updated to version 4.0. Key changes include the calibration of task resources (time, CPU, memory), implementation of task fixes, and the removal of saturated tasks.
Related event: Terminal-Bench 4.0 Released: Opus 5 Leads, GLM 5.3 Top Open-Source Model(14 posts)→
More from Research
- WorldMemArena Accepted at NeurIPS: Memory Storage ≠ Memory Use — xwang_lk · 2026-10-16
- Mech Interp Veteran Rethinks Alignment, Misgeneralization, CoT Oversight — akbirthko · 2026-10-16
- WEDGE paper generates training environments conditioned on navigation agent failures — _akhaliq · 2026-10-16
- RExBench: best coding agent completes only 33% of autonomous research extensions — najoungkim · 2026-10-16
- Google's CLASHarness benchmarks multi-agent conflicts in computer use, finds frontier VLMs struggle — google · 2026-10-16
- Tsinghua team proves vanilla flow-matching sampling can't exceed constant-depth expressive power — SQZ · 2026-10-16