Harvard Paper: Coding Agents Re-read 94.8% of Tokens, Pushing Energy Use 25x Higher

rohanpaul_ai · x · 2026-11-18

A Harvard paper analyzing 1 billion tokens from 10 weeks of real AI-assisted development (42 sessions, 752 task episodes) finds cached-context reads account for 94.8% of all API-reported tokens — agents spend most compute re-reading history, not doing new work. Every generated token triggers 260 cached-token reads. Extending an analytical estimator to include cached-context processing yields 250 kWh for the workload vs 10 kWh under output-based EcoLogits, a 25-fold gap. Agent energy accounting must move beyond per-request token estimates.

Original post →

More from coding & agent

coding & agent channel →