Anthropic Opens Real Claude Usage Data to Researchers

Episode 1 · Anthropic Opens Real Claude Usage Data to External Researchers, Revealing How Humans Actually Collaborate with AI (2026-08-27, 13 posts)

Anthropic has for the first time opened privacy-protected, aggregated real Claude usage data to external researchers through Anthropic Insights (formerly Clio). Jack Clark argued that AI systems are too complex for lab-internal evaluation alone, calling such an approach arrogant and wrong. Three external research groups completed independent analyses during the pilot, most notably Stanford's Diyi Yang team with "Human–AI Collaboration at Scale," establishing a new paradigm for independently studying AI's real-world impact.

Confirmed

• Data access: Anthropic Insights (formerly Clio) provides aggregated, privacy-protected telemetry data to external researchers and institutions for studying AI's actual impact.
• Study scale: the Stanford analysis is based on 249,834 real Claude conversations.
• Task criticality: contrary to the belief that users only delegate low-stakes work, users frequently delegate high-stakes, hard-to-reverse tasks in legal and financial domains; as risk rises, users' willingness to adapt or critique AI output decreases, shifting toward trying to understand it.
• Collaboration mode: AI mainly serves as augmentation rather than full automation; human-led collaboration accounts for 72%, with deeper human involvement for more important tasks; AI exhibits teaching behavior in 67% of conversations.
• Friction: 49.7% of conversations involve some form of friction; users actively attempt recovery in 78.7% of these cases, with questioning the model's reasoning, requesting simplification, and correcting factual errors among the most effective strategies.

Why it matters

• The Stanford team concluded that all findings ultimately point to the human factor: improving AI capability alone is insufficient for strong human-AI collaboration.
• Opening usage data breaks labs' monopoly, enabling independent study of AI's real-world effects.
• The finding that users correct AI less in high-stakes settings carries direct implications for AI safety and interaction design.

• Anthropic opens privacy-preserved Claude data to external researchers — AnthropicAI · 2026-08-27
• Anthropic pilots external access to privacy-preserved Claude data — Diyi_Yang · 2026-08-27
• Users Less Likely to Critique AI in High-Stakes Tasks — EchoShao8899 · 2026-08-27
• Anthropic enables research on human-AI collaboration using real data — Diyi_Yang · 2026-08-27
• Users Delegate High-Stakes Tasks to AI at Surprisingly High Rates — EchoShao8899 · 2026-08-27
• Study Finds Friction in 49.7% of Human-AI Conversations, Reveals Effective Recovery Strategies — EchoShao8899 · 2026-08-27
• Anthropic Study: Human-AI Collaboration at Scale Across 250k Conversations — EchoShao8899 · 2026-08-27
• Anthropic opens Claude usage data to independent researchers — EchoShao8899 · 2026-08-27
• Anthropic opens pilot for external researchers to access privacy-preserved Claude data — mattbeane · 2026-08-27
• Study on 250k Conversations: How Humans Collaborate with AI — Diyi_Yang · 2026-08-27
• Anthropic study: 72% of AI conversations remain human-led — Diyi_Yang · 2026-08-27
• Stanford Study: AI-Augmented Work Dominates in 249k Real Claude Conversations — EchoShao8899 · 2026-08-27
• Anthropic Opens Privacy-Preserved Claude Data for Research — Diyi_Yang · 2026-08-27

Episode 2 · Anthropic Analyzes 400K Claude Code Sessions: Domain Expertise Drives Better Results (2026-08-28, 2 posts)

Anthropic analyzed roughly 400,000 Claude Code sessions from about 235,000 users over seven months, finding that humans handle 70% of planning decisions while AI handles 80% of execution. The study also shows domain experts achieve notably higher success rates with the tool.

• Study of 400k Claude Code sessions: Domain expertise beats coding skills — alex_verem · 2026-08-28
• Anthropic Study: Domain Experts See Higher Success Rates with Claude Code — alex_verem · 2026-08-28