Bedrock adds explicit prompt caching for open-weight models, cutting input costs

AWS ML Blog · rss · 2026-11-16

AWS ML Blog explains using prompt caching with open-weight models on Amazon Bedrock to cut input costs and latency for repeated long contexts.

Two modes

Billing: cache reads bill below standard input; cache writes may bill higher; TTL resets on each hit. The post walks through caching a 4,000-token product manual with the OpenAI Python SDK plus short-term Bedrock API keys, applying implicit caching to an OpenCode coding agent session, and reading cache usage fields from responses.

Original post →

More from coding & agent

coding & agent channel →