AIOE co-author Rob Seamans responds: EFF AI metrics feed stopped updating around 2017
robseamans · x · 2026-10-14
Rob Seamans responded to the Gulati/Prokopets "AI benchmarks → occupational exposure" paper, noting it is similar in spirit to his AIOE (AI Occupational Exposure) index with Manav and Ed Felten. The original plan was to update AIOE as EFF AI metrics (compiled by Jack Clark and Miles Brundage) were updated — but that stopped happening around 2017.
This context explains why a new generation of researchers is turning to AI benchmark scores as a dynamic data source for measuring occupational exposure.
More from AGI Musings
- Distrusting experts passes as critical thinking, distrusting conspiracies as closed-mindedness — DanielWhiteson · 2026-10-14
- Mathematicians clash with OpenAI over how it handled Millennium Problem solutions — paulnovosad · 2026-10-14
- The Remote-vs-Office Debate Misses the Point: Will Your Role Survive Entropy Collapse? — AryHHAry · 2026-10-14
- Anthropic researcher reportedly told friend he's 'enjoying my last six months' — notkilleveryoneist · 2026-10-14
- Jan Kulveit Bets Against AI 2027: Reality Tracks My Timeline, Not Kokotajlo's — jankulveit · 2026-10-14
- Charts suggest AI agent flooding is surging complaints and litigation across multiple countries — RexDouglass · 2026-10-14