Epoch AI launches Capabilities Index (ECI), a unified scale for comparing model intelligence over time
ricklamers · x · 2026-10-07
Epoch AI released the Epoch Capabilities Index (ECI), which combines scores from many AI benchmarks into a single "general capability" scale, enabling model comparisons across timespans long enough for individual benchmarks to saturate.
Key points:
- ECI supports frontier-trend charts over time and training compute, plus leaderboards and per-domain views.
- Each ECI value maps back to expected benchmark scores via logistic fits; steeper sigmoids indicate benchmarks will saturate quickly, while scores near 0% or 100% mean a benchmark can no longer discriminate between models.
- Data is openly available under CC-BY for download and reuse.
More from Research
- MEMOIR-VLM hits 91.3% balanced accuracy on dementia classification with missing brain-scan inputs — PTenigma · 2026-10-07
- Claude paper's prompter was an Anthropic employee, authors were just digesters, says user — analisereal · 2026-10-07
- Claude math result row: prompter was an Anthropic employee, authors say they were the "digesters" — analisereal · 2026-10-07
- ChipForge NPU Challenge Goes Live: Crowdsource AI Accelerator Designs Headed to Real Silicon — bittingthembits · 2026-10-07
- SIGGRAPH Asia 2026 Lineup: Disney's Markus Gross, Huawei's Ran Huang, Oxford's Andrea Vedaldi — AlexTensor · 2026-10-07
- CoreWeave RL Rollouts Hot-Loads Policy Weights Into Live Deployments, ~15x Faster Than Redeploys — _ScottCondron · 2026-10-07