Paper: AI coding prompts grow 226% due to 'catastrophic remembering'; comments can cut excess by 99.3%

rohanpaul_ai · x · 2026-09-07

The arXiv paper 'Why Does CLAUDE.md Keep Growing? Catastrophic Remembering in Agentic Coding' by Kushal Chakrabarti investigates the unbounded growth of instruction files (e.g., CLAUDE.md) in AI coding. Analyzing 247,694 instruction lifetimes across 1,867 repositories, the author finds that agentic prompts grow without bound, more than tripling (+226%) and gaining +4.9 net instructions per commit; older instructions are less likely to be deleted (log-hazard -0.032/commit). The phenomenon is termed 'catastrophic remembering,' the inverse of catastrophic forgetting. The proposed fix is to attach comments encoding latent reasoning, hidden from the executing model. In controlled IFEval tests, comments removed 99.3% of excess instructions (+211.3% to +1.4%); on WildIFEval, comments improved real-world instruction-following by up to 23.1%. The paper asks: 'If English is the new code, why don't we have comments yet?'

Related event: Study Finds AI Coding Instruction Files Grow 226%, Dubbing It 'Catastrophic Remembering'(2 posts)→

Original post →

More from coding & agent

coding & agent channel →