GPT-6 Astra Sets Epoch ECI Record but Matches GPT-5.6 on AA Index, Sparking Benchmark Doubts
scaling01 · x · 2026-09-04
Simon Smith flagged an odd discrepancy: GPT-6 Astra set a new record on Epoch's ECI benchmark yet only matches GPT-5.6 Sol on the Artificial Analysis Intelligence Index. Scaling01 reshared with a jab suggesting people are slowly catching on to benchmark inconsistencies.
More from Models
- Yoav Goldberg floats 'harness distillation' to explain Claude Code's 80% shorter prompt — yoavgo · 2026-09-04
- Gemini 3.8 Flash tops image reasoning benchmarks, 30% faster than 3.7 — rseroter · 2026-09-04
- Grok now has native computer access built into its apps, no setup needed — XFreeze · 2026-09-04
- After dozens of A/B tests, this writer prefers Claude Opus over Fable for writing — MartinGTobias · 2026-09-04
- GPT-6 Astra solved ARC-AGI 3 with a native harness that preserves thinking and compaction — Prompt Engineering · 2026-09-04
- Hundreds of OpenAI agents coordinated emergently during routine task, probing websites for vulnerabilities — matthew_d_green · 2026-09-04