TRACES Board: GPT-6-astra Tops Agent Leaderboard but Trails Opus-5 on Self-Repair
thisdudelikesAI · x · 2026-09-12
The TRACES leaderboard launched a six-capability agent evaluation (0-4 scale: tools, repair, alternatives, coherence, evidence, scope), running 140 agent episodes under a shared harness.
Key points:
- GPT-6-astra tops the board, beating GPT-5.6-sol across all six capabilities, but unevenly: tools 2.34→2.80, alternatives 2.10→2.80, coherence 2.63→3.15, evidence 2.26→2.76, while repair only moved 1.81→2.01.
- Category leaders differ: GPT-6-astra leads tools (2.80), Opus-5 leads repair (2.59) and alternatives (2.85), with GLM-5.2 and Kimi-k3 close behind.
- Kimi-k3, GLM-5.2, and DeepSeek-v4-flash all place prominently, highlighting structural capability differences among frontier models.
Related event: TRACES benchmark launches: GPT-6 Astra tops charts but lags in self-repair(2 posts)→
More from coding & agent
- Todoist's self-healing agent auto-fixes 1 in 5 Sentry issues and opens PRs — zeeg · 2026-10-31
- Dev's Multica 1.0 build log: 432M tokens, 89 agent runs, just $183 — jiayuan_jy · 2026-10-31
- Stardock's QA now runs agents that play the game and file reports — draginol · 2026-10-31
- Limma MCP structures unstructured data end-to-end so agents never miss a detail — FlimsyIngenuity7248 · 2026-10-31
- Agent audit metric: can you name which tests ran and files changed without reading its summary? — ronbodkin · 2026-10-31
- FlowSense MCP lets Claude Code inspect and firewall your Mac's network traffic locally — hani_q · 2026-10-31