NBER RCT: AI Boosts Junior Patent Lawyers' Output but Leaves No Lasting Skill Gains
David Autor's team published a three-month preregistered RCT (NBER Working Paper 35720) examining AI assistance in patent drafting. 133 practicing patent lawyers across 11 US IP firms received a custom AI drafting assistant, with output scored by blinded expert attorneys. AI improved output quality, but gains were sharply stratified: juniors' improvements vanished once the tool was removed, while seniors' gains persisted.
Confirmed
- Design: preregistered RCT, 11 US IP firms, 133 practicing patent lawyers, three months, custom AI drafting assistant, blinded expert grading (m2, m5).
- With AI, patent documents were better at both 10-day and 90-day checkpoints; juniors benefited most, gaining 0.58 and 0.60 standard deviations respectively (m1, m2).
- After tool removal, junior gains disappeared entirely, leaving no durable capability or skill improvement (m3, m4).
- Senior gains persisted after tool removal; @zivravid infers that solid underlying judgment/experience explains the difference (m4).
- AI assistance did not improve juniors' underlying judgment (m1, m5).
Why it matters
- @zivravid notes the contrast with earlier Stanford employment data: even juniors who keep their jobs may see skill accumulation stall due to AI reliance, raising concerns about weakened early-career skill formation.
- For organizations, the experiment suggests layered AI value: it is a productivity amplifier for juniors, not a teacher, and talent-development strategies may need redesign.
2026-09-22 ~ 2026-09-24 · 5 related posts
- Episode 1: NBER trial: AI drafting tool benefits senior patent lawyers most(2026-09-19, 2 posts)
- Episode 2: NBER RCT: AI Boosts Junior Patent Lawyers' Output but Leaves No Lasting Skill Gains(2026-09-22, 5 posts)
Primary sources
- NBER RCT: AI boosts junior patent lawyers' output by 0.6 SD but builds no lasting judgment — rohanpaul_ai ·
- Autor's RCT: AI Boosts Patent Drafting Quality, But Junior Lawyers' Gains Bifurcate — danielrock ·
- NBER RCT: juniors' AI productivity gains vanish entirely once the tool is removed — ziv_ravid ·
- RCT of 133 patent lawyers: AI boosts junior output but fails to build underlying judgment — rohanpaul_ai · 2026-09-22
- Juniors' AI gains vanish with zero durable improvement, NBER RCT finds — ziv_ravid · 2026-09-22
3 near-duplicate retellings: rohanpaul_ai · ziv_ravid · danielrock