Anthropic RCT with 50 analysts: do experts still decide when delegating to agents?
voooooogel · x · 2026-10-28
Anthropic's new study, 'How AI agents shape experts' judgment calls,' ran a randomized trial with 50 professional data analysts to test whether experts still make the key decisions when delegating work to an agent. Quoting jankulveit: the research also illustrates the danger of the 'it's just a tool' mindset — modeling AIs as independent minds you collaborate with makes it easier to track ideas and reduces risk.
Related event: Anthropic RCT: Analysts deferred to AI agents on 86% of judgment calls(14 posts)→
More from AGI Musings
- tszzl: Early AGI signs were obvious to Scott Alexander and Gwern readers — tszzl · 2026-10-28
- Shkreli vs ChrisGPT: does AGI 'curing' diseases actually count as a cure? — ChrisGPT · 2026-10-28
- Anyone can imagine a language as fast as C and as dynamic as Lisp — until they sit down — math_rachel · 2026-10-28
- Rachel Thomas threads zetalyrae: why 'the ideas are mine, the writing is AI' is wrong — math_rachel · 2026-10-28
- Emmett Shear's Softmax essay argues trust is a property of relationships, not models — Hidenori8Tanaka · 2026-10-28
- Biotech founder: most 2023 customers are dead or pivoted to data generation — kenbwork · 2026-10-28