CAIS and Scale AI Launch Remote Labor Index to Measure AI Automation of Remote Work
ben_j_todd · x · 2026-11-17
The Center for AI Safety (CAIS) and Scale AI have jointly released the Remote Labor Index (RLI), a new benchmark measuring how much AI automates remote work. The large author list is led by Mantas Mazeika, Alice Gatti and colleagues, with Dan Hendrycks, Summer Yue, and Scale AI's Alexandr Wang as senior authors.
Motivation: AI has made rapid progress on research-oriented knowledge and reasoning benchmarks, but measuring its ability to automate real human labor has lagged — RLI aims to fill that gap. The paper and code are open-sourced on GitHub, with an online index page that will track the metric's trajectory over the coming year.
More from AGI Musings
- AI raised the ambition floor: researcher now lets optimization runs continue past the first win — generativist · 2026-11-17
- Why the AI safety movement is hard to beat: it lures Jane Street traders to $60k Hill jobs — panickssery · 2026-11-17
- Ben Todd extrapolates remote-work automation: odds doubling every 2 months, near-100% by 2028 — ben_j_todd · 2026-11-17
- Fields Medalist: AI Has Hit Math at Full Throttle, and Mathematicians Are Struggling — haider1 · 2026-11-17
- Oxford, DeepMind, OpenAI & Anthropic paper argues safe AI isn't the same as good AI — alex_verem · 2026-11-17
- a16z Introduces the B2A Economy: Agents Are Now the Internet's Primary Users and Buyers — venturetwins · 2026-11-17