OpenAI launches Prompt Caching Dashboard and diagnostics API to track cache-hit rates
OpenAIDevs · x · 2026-09-23
OpenAI shipped a set of prompt-caching tuning tools for developers: explicit cache breakpoints to choose which prompt prefixes get reused, the ability to adjust reasoning effort and tool availability while preserving cached context, and prewarming of shared context for faster first responses. A new Prompt Caching Dashboard tracks cache-hit rates, and a diagnostics API identifies changes that broke reuse and estimates affected token counts.
More from coding & agent
- User automates entire video clipping workflow with Nous Research's Hermes agent — Teknium · 2026-11-12
- As models improve, writing good evals gets harder and more important — amankhan · 2026-11-12
- Free AI game jam in SF Nov 14–15 with teams from Anthropic, Google, Meshy, OpenAI — chrisfirst · 2026-11-12
- Omarchy 4.6 lets you share local AI models across your tailnet, says DHH — alexcovo_eth · 2026-11-12
- Coding harnesses hand shell access to inference providers — 4-step gateway mitigation — shensi · 2026-11-12
- Slack's David Hoang: agents beat people on coordination, proposes 'boundary agents' — davidhoang · 2026-11-12