CMU/JetBrains paper: engineer token spend measures AI usage, not output shipped
rohanpaul_ai · x · 2026-11-12
A new Carnegie Mellon and JetBrains paper, "The AI Era's Lines of Code? A Case Study on What an Engineer's Token Spend Measures", examines what token spend actually captures.
- Context: Companies now track engineers' coding-agent token spend to set budgets and judge productivity, some even ranking top users.
- Method: Linking 5 weeks of coding-agent token use to the commits of 404 JetBrains engineers — the first study to follow both spend and output for the same engineers over time.
- Finding: Token spend reflects how much engineers use AI agents, not how much they ship — token spend is becoming the misleading productivity metric of the AI era, like lines of code before it.
Related event: CMU Study: Doubling Token Spend Yields Only ~10% More Commits(2 posts)→
More from coding & agent
- Dev's favorite AI use case: Claude monitors competitors and emails alerts — doooyle · 2026-11-12
- LLM controls vocal synth to perform Ave Maria in 4-part harmony — AAAzzam · 2026-11-12
- ArcGrav: a cross-model Agent Control Language to cut token overhead — ArchitecturalGravity · 2026-11-12
- Claude watches competitors around the clock and emails me what matters — GlenBradley · 2026-11-12
- Developers say Gemini 4 Carbon is notably better at favicon design and micro-interactions — AI_Andrew · 2026-11-12
- v0 now supports ChatGPT Business subscriptions alongside Plus and Pro — OpenAIDevs · 2026-11-12