Ethan Mollick: people take the Artificial Analysis Index and its scores way too seriously
emollick · x · 2026-10-13
Wharton professor Ethan Mollick argued that people take the Artificial Analysis Index and its individual scores far too seriously. The short remark pushes back at leaderboard worship in AI circles — aggregate scores can mask how differently models behave on real tasks.
More from Models
- Meta skipped the 'too dangerous to release' marketing for Muse Wonder — and could rival Google — haider1 · 2026-10-13
- Anthropic says new defenses cut distillation attack data harvesting by 90-99%, cites Zhipu's GLM-5.3 — AnthropicAI · 2026-10-13
- Delve Town's 'bee' model was further trained by Claude for ~24 hours — Sauers_ · 2026-10-13
- Muse Wonder disappoints on RareBench: Opus 5.5 leads at 52% recall — danielmckinn0n · 2026-10-13
- Chart sparks debate: Are Anthropic and OpenAI really months ahead of Meta and Google? — scaling01 · 2026-10-13
- GPT-6 Astra and Claude Opus 5 nearly tied on embodied task: 34-6 over 40 votes, 16-point Elo gap — qinzytech · 2026-10-13