Estimated Anthropic internal model scores show only ~4.5-point AECI gain across three generations
ChrisGPT · x · 2026-11-07
Reading from METR's chart, a poster estimates Anthropic internal model AECI scores: Model 2 174.1, Model 3 177.0 (+2.9), Model 4 178.6 (+1.6) — a 4.5-point gain across three generations.
Caveats: AECI differs from Epoch's ECI so scores aren't directly comparable; even assuming Model 4 is Fable 5.5, per-generation gains are 1.7% and 0.9% of the index; AECI uses an arbitrary scale (for reference, Astra scores 169 on ECI).
Related event: Leaked METR Chart Reveals Anthropic's Unreleased Model Progress(3 posts)→
More from Models
- Kimi K3.1 Pro turns a photo into a 3D Three.js scene, with open-sourced template — demian_ai · 2026-11-07
- Nous Research releases Arete-27B, cutting a Chinese open model's propaganda rate from 22% to 1% — NousResearch · 2026-11-07
- Claim: GPT-6 Astra's robotics skills aren't emergent — it trained on robotics-specific data — gleech · 2026-11-07
- LMArena launches Code Arena with WebDev categories for head-to-head coding tests — arena · 2026-11-07
- Empero's Manta claims a 100-million-token context window in a single prompt — emdeka87 · 2026-11-07
- Team bans commas and noun-phrase clustering to scrub Claude's AI writing tells — layer07_yuxi · 2026-11-07