GPT-6 Astra's Epoch ECI Score Revised Down on Weak Long-Horizon Software Engineering
Jsevillamol · x · 2026-09-17
Jsevillamol of Epoch AI shared an update on GPT-6 Astra's Epoch Capabilities Index (ECI) score.
- Earlier results showed Astra leading the ECI ahead of competitors like Claude Fable 5.1, with a record-setting Math-ECI, while Fable 5.1 remained state-of-the-art on software engineering benchmarks.
- The revised score is a major step down from the originally reported figure, though still within the expected uncertainty range.
- The revision is attributed to weaker performance on long-horizon software engineering tasks.
Related event: GPT-6 Astra Tops Epoch Capabilities Index Despite Score Revision(2 posts)→
More from Models
- Open-source VoxLock tops Krisp voice isolation benchmark with 4.95% WER — Arbaz Siddiqui · 2026-11-02
- Anthropic's 85% inference margin sparks debate on open source's price-pressuring role — code_star · 2026-11-02
- User reports xAI appears to have quietly raised weekly usage limits, dropping his meter from 93% to 47% — XFreeze · 2026-11-02
- Meituan's LongCat-2.5 lands as 1.6T MoE agent model, with DeepSeek copycat speculation — teortaxesTex · 2026-11-02
- Asked what AI firms want you to stop owning, Claude said: your own compute — alex_verem · 2026-11-02
- Is Hermes Still Worth It? Codex's $200 Tier Now Overlaps Most of Its Value — Foreign_Lead_3582 · 2026-11-02