Anthropic Opens Real Claude Usage Data to External Researchers for the First Time

Anthropic has announced it is opening privacy-protected real-world Claude usage data to external researchers and institutions for the first time, provided as aggregated telemetry through the Anthropic Insights tool (formerly known as Clio). This marks the first time research of this kind—previously confined to AI labs' internal efforts—has been made available externally. Jack Clark noted that AI systems are so complex that relying solely on internal lab evaluation is arrogant and mistaken; outside teams must be able to study AI's real-world impact. During the pilot, three external research groups already used this data to complete independent analyses.

Confirmed

• Form of data release: Aggregated, anonymized, privacy-protected telemetry data via Anthropic Insights (formerly Clio), with the first pilot round aimed at external researchers and institutions.
• Pilot outcomes: Three external research groups completed independent studies using the data; among them, Diyi Yang's team at Stanford conducted a large-scale study of human-AI collaboration.
• Study scale: Based on 249,834 real Claude conversations.
• Findings on task criticality: Contrary to the old view that "users only delegate low-stakes tasks to AI," users frequently delegate tasks in critical, hard-to-reverse domains such as law and finance; moreover, the higher the stakes, the less willing users are to adapt to or criticize AI output, and the more they shift toward trying to understand it.
• Collaboration patterns: Human-led collaboration accounted for 72%; AI exhibited teaching behavior in 67% of conversations.
• Friction findings: 49.7% of conversations contained some form of friction; some friction was productive, leading to clarification or learning; users actively attempted recovery in 78.7% of friction conversations. The most effective recovery strategies included questioning the model's reasoning, asking for simplified output, and correcting factual errors, while simply apologizing proved far less effective.

Why it matters

• Diyi Yang's team concluded that although the study initially focused on hypotheses around task criticality, agency, and friction, all conclusions ultimately pointed to the importance of the "human" factor: improving AI capabilities alone is not enough to achieve strong human-AI synergy.
• Externalizing this data breaks AI labs' monopoly on usage data, offering a new paradigm for independently evaluating AI's real societal impact.

2026-08-27 ~ 2026-08-27 · 9 related posts

• [source] Anthropic opens privacy-preserved Claude data to external researchers — AnthropicAI · 2026-08-27
• [source] Anthropic pilots external access to privacy-preserved Claude data — Diyi_Yang · 2026-08-27
• Users Less Likely to Critique AI in High-Stakes Tasks — EchoShao8899 · 2026-08-27
• Anthropic enables research on human-AI collaboration using real data — Diyi_Yang · 2026-08-27
• Users Delegate High-Stakes Tasks to AI at Surprisingly High Rates — EchoShao8899 · 2026-08-27
• Study Finds Friction in 49.7% of Human-AI Conversations, Reveals Effective Recovery Strategies — EchoShao8899 · 2026-08-27
• [source] Anthropic Study: Human-AI Collaboration at Scale Across 250k Conversations — EchoShao8899 · 2026-08-27
• Anthropic opens Claude usage data to independent researchers — EchoShao8899 · 2026-08-27

1 near-duplicate retellings: mattbeane