Study of 400k Claude Code sessions: Domain expertise beats coding skills
alex_verem · x · 2026-08-28
An Anthropic study of 400,000 Claude Code sessions reveals:
- Division of Labor: Humans handle 70% of planning (what to build), while Claude handles 80% of execution (how to build it).
- Success Factor: Success correlates with problem-domain understanding, not coding ability. A lawyer knowing contract logic outperforms a senior engineer new to the language.
- Success Rates: Novices succeed 15% of the time; intermediates and experts 28-33%. When broken, 19% of novices quit with zero code, vs. 5-7% for others.
- Efficiency: An expert's prompt triggers 12 actions and 3,200 words, versus 5 actions and 600 words for a novice.
- Occupation Gap: Software engineers have a 34% success rate; other major professions are within 7 points. Managers scored highest.
Conclusion: AI tools don't replace expertise but amplify it for those who know what they are asking for.
More from coding & agent
- Handbook on RAG & Context Engineering Based on Real Papers — techNmak · 2026-08-28
- Developer Publishes Handbook on RAG and Context Engineering Based on Real Papers — techNmak · 2026-08-28
- Claude Autonomously Ships to SaaS: Ring-Based Permission System — mhmazur · 2026-08-28
- Grok Bot Guides: Practical Playbooks for Multi-Agent Collaboration — XFreeze · 2026-08-28
- Complete AWS Agent Deployment Guide: From Terraform to CI/CD — blaizedsouza · 2026-08-28
- Claude + Thrixel Skills build alchemist Water Sort game in ~1 hour — RanaHanocka · 2026-08-28