TRACES benchmark: GPT-6 Astra gains on all six axes but Repair lags
rohanpaul_ai · x · 2026-09-13
@ApodexAI launched TRACES, a benchmark for hard scientific discovery where answers may be unknown, scoring process across six dimensions (Tools, Repair, Alternatives, Coherence, Evidence, Scope). Over 140 agent episodes, GPT-6 Astra beats GPT-5.6-sol on all six — but Repair (fixing its own errors after feedback) improved least, 1.81→2.01. Key insight: a correct final answer can hide weak investigation; agents that ignore contradictory feedback may pass now and fail later.
Related event: TRACES benchmark launches: GPT-6 Astra tops charts but lags in self-repair(2 posts)→
More from Models
- Inside Decision Models: How Perplexity's Decider Works and When to Use One — antoine_chaffin · 2026-10-31
- GPT-6.5 Astra rumored to be a beast, hinting at OpenAI's next model — daniel_mac8 · 2026-10-31
- Anthropic's poisoned-dataset alignment test sparks speculation about distillation sabotage — teortaxesTex · 2026-10-31
- Gemini 4 Carbon takes #1 on Vending-Bench 2 at lower cost than rivals — vedantmisra · 2026-10-31
- Particle-1, a token-efficient model, launches on Cloudflare AI Gateway — garrytan · 2026-10-31
- OpenAI Claims Proof That L = BPL, Hinting at AI-Generated Formal Mathematics — chaumian · 2026-10-31