Paper: AI coding prompts grow 226% due to 'catastrophic remembering'; comments can cut excess by 99.3%
rohanpaul_ai · x · 2026-09-07
The arXiv paper 'Why Does CLAUDE.md Keep Growing? Catastrophic Remembering in Agentic Coding' by Kushal Chakrabarti investigates the unbounded growth of instruction files (e.g., CLAUDE.md) in AI coding. Analyzing 247,694 instruction lifetimes across 1,867 repositories, the author finds that agentic prompts grow without bound, more than tripling (+226%) and gaining +4.9 net instructions per commit; older instructions are less likely to be deleted (log-hazard -0.032/commit). The phenomenon is termed 'catastrophic remembering,' the inverse of catastrophic forgetting. The proposed fix is to attach comments encoding latent reasoning, hidden from the executing model. In controlled IFEval tests, comments removed 99.3% of excess instructions (+211.3% to +1.4%); on WildIFEval, comments improved real-world instruction-following by up to 23.1%. The paper asks: 'If English is the new code, why don't we have comments yet?'
More from coding & agent
- DeepMind paper: LLMs can't sample randomly on their own — pass random numbers from code instead — rohanpaul_ai · 2026-10-27
- BELL: Open-Source Stack Combines Browserbase, Eve, iMessage and Stripe Link for Personal Agents — jeff_weinstein · 2026-10-27
- Legora runs 2,000 parallel agent evals on Modal Sandboxes for legal AI — blelbach · 2026-10-27
- Two engineers rebuilt a FedEx supplier's billing core in 3.5 months vs an estimated 7-8 — alex_verem · 2026-10-27
- GPT-6.1 Terra scores 48 on AA Coding Agent Index at one-third the cost of GPT-5.6 Terra — ArtificialAnlys · 2026-10-27
- Shift-1 router cuts coding agent spend up to 55% while keeping SWE-bench accuracy — ypatil125 · 2026-10-27