scaling01: 200 ECI is just a vibe estimate without benchmark details
scaling01 · x · 2026-11-06
scaling01 argues that a 200 ECI score is a 'vibe estimate': without knowing the benchmarks and tasks behind it, a single AECI number is useless. He notes ECI rose from 160 to 170 this year with models now producing Fields-medal-worthy proofs, but anonymous benchmark scores alone can't support conclusions.
Related event: scaling01: Single AECI Score Meaningless, Calls for Public Benchmarks(2 posts)→
More from Models
- Scale AI ships 3,300+ RL environments; some tasks take humans 3 weeks and 500+ tool calls — alexandr_wang · 2026-11-06
- Mercury 3 hits 2 trillion tokens in under two weeks as daily usage climbs linearly — StanfordAILab · 2026-11-06
- Same local model gives different answers via LM Link on iPhone vs direct on Mac — simplext · 2026-11-06
- "Anthropic valuation dropped from $2T to $20B — AI told me" — michalmalewicz · 2026-11-06
- One-letter URL encoding bypass exposed Hugging Face chat admin API, bulk export of private chats — cyb3rops · 2026-11-06
- Tencent Hy4 lands on OpenDesign with frontend and complex UI upgrades — TencentHunyuan · 2026-11-06