What Sneakily Spiked Your LLM Bill? Cache-Killing Prompts and Billed Retries

Junior-Guitar-290 · reddit · 2026-11-19

A Reddit thread collects war stories about hidden LLM/agent bill spikes. Two examples: putting the current date at the top of a system prompt collapsed cache hits to near-zero overnight (token counts identical, only the bill changed); lowering client timeouts triggered retries on long calls, and the provider billed the abandoned calls — none of which appeared in app logs. The OP is exploring a product in this space and asks what caused spikes, how long detection took, and what caught them.

Related event: Tiny Prompt Tweaks Trigger Huge LLM Bills, Reddit Finds(2 posts)→

Original post →

More from coding & agent

coding & agent channel →