NBER field experiment: AI boosts patent lawyers' skill, but gains accrue only to senior lawyers
avicgoldfarb · x · 2026-09-19
A pre-registered 3-month RCT by David Autor and co-authors gave 133 patent lawyers at 11 US IP firms a custom AI drafting assistant, with work blind-scored by expert patent attorneys.
- With AI: benchmark drafting quality rose 0.34 SD at day 10 (p=0.03) and 0.38 SD at day 90 (p=0.01), with larger gains for junior lawyers.
- Without AI: after three months, treated lawyers outperformed controls on a redlining task by 0.32 SD (p=0.04), but the advantage was concentrated entirely among senior lawyers (0.45 SD); junior lawyers showed no average gain, with scores bifurcating into fewer mediocre but more poor and more good ones.
The authors conclude that foundational expertise may be a prerequisite for extracting durable skill from AI-assisted practice — the largest gains accrued to those who relied on it least.
More from AGI Musings
- AI community clashes over 'rogue agents' narrative: Redwood and METR quotes fuel the debate — Dan_Jeffries1 · 2026-09-19
- Fields Medalist Villani 'shaken' by OpenAI's claimed millennium problem solution — akbirthko · 2026-09-19
- Most Jobs Don't Involve Einstein-Level Science — and Breakthroughs May Not Boost Growth — binarybits · 2026-09-19
- Thom Wolf: big labs are air-gapped, but researcher departures still leak information — Thom_Wolf · 2026-09-19
- Timothy B. Lee: his wait-and-see AI policy argument fails under 'fast takeoff' — binarybits · 2026-09-19
- 'Doomers are not serious people': the GPT-6 release reignites AI risk debate — inductionheads · 2026-09-19