GPT-6.2 breaks Responses API prompt caching: hit rate falls from 97.4% to 46.4%

lxfater · x · 2026-11-22

Developers report that GPT-6.2 changed Responses API prompt caching behavior: fixed rules placed in top-level instructions are now moved to the end of the conversation, so they never hit the cache and get re-billed at full price every turn.

Official workaround: stop putting fixed rules in top-level instructions; put them as the first item of the input list with the developer role. OpenCode verified that after the move, cache hit rates for both Sol and Astra return above 97% from the second turn.

How to check: inspect cachedtokens in your logs — if the cached share suddenly collapsed, check where your rules sit, or update your tooling.

Original post →

More from coding & agent

coding & agent channel →