Study on 250k Conversations: How Humans Collaborate with AI
Diyi_Yang · x · 2026-08-27
Drawing on a corpus of 249,834 real-world conversations with Claude provided by Anthropic, this study investigates human-AI collaboration patterns. Key findings include:
- Task Criticality: Users delegate both trivial and consequential, hard-to-reverse tasks to AI. As stakes rise, engagement increases, with conversation length nearly doubling for high-stake tasks.
- Human Agency: Human-led collaboration dominates, but users construct their level of agency through prompting. A key tension is whether AI builds human capability or substitutes for effort.
- Friction & Learning: Friction arises in roughly half of conversations but is often productive. Active teaching is common (67% of conversations) but benefits are unevenly realized.
More from Research
- New theory: Aging begins when cells lose shared developmental goals — rand_longevity · 2026-08-29
- SIGCOMM 2026 data: China now produces 57% of papers, surpassing US — vishalmisra · 2026-08-29
- MIT Prof. Patrick Winston Breaks Down the Simplest Neural Network — MIT_CSAIL · 2026-08-29
- First Text-to-SQL Model Beats Human Benchmark Using RLVR — EchoShao8899 · 2026-08-28
- Paper: Sol 5.6 Achieves 46% Accuracy on BrowseComp-Plus Without Search — beirmug · 2026-08-28
- Claude vs Gemini: Both Hit 98.67% Semantic Pass Rate but Fail Differently — Plastic-Cell-4497 · 2026-08-28