Analysis of 769 task logs: AI agents propose 55% of methods, humans make 85% of calls
The Decoder · rss · 2026-09-27
A research team analyzed 769 task logs from building its own AI model, quantifying how much AI agents actually contribute to research:
- AI agents supplied up to 55% of method proposals, but humans made more than 85% of final decisions
- About one-third of tasks wouldn't have been attempted without AI assistance
- The authors caution that more agent activity doesn't mean more autonomy — contribution and decision-making authority remain distinct
The study offers rare first-hand quantitative data on whether AI agents can substitute for human researchers.
More from AGI Musings
- Malthus Saw It in 1798: Wealthy Avoiding Kids, Delayed Marriage Repeats Today — SydSteyerhart · 2026-11-16
- Runway CEO Predicts Fully AI-Generated Cultural Phenomenon by 2027 — c_valenzuelab · 2026-11-16
- '5% worse and 10% cheaper': the button with no vote is already everywhere — eigenrobot · 2026-11-16
- Effective Altruism is top-down and hierarchical, not a grassroots movement — ctjlewis · 2026-11-16
- Lawyers say clients' AI use creates unrealistic expectations and fake case law in settlements — hoofnagle · 2026-11-16
- Dev debunks 'rogue AI' hype: subsidized subscriptions can't fund expensive swarms — gerardsans · 2026-11-16