Blog calls for prompt caching in Jev-style models as OpenAI ships Decisions API
emschwartz · reddit · 2026-09-30
Author emschwartz published a post arguing that prompt caching should be added to "Jev-style" models, noting that OpenAI announced its Decisions API while the post was being written — making the topic timely.
The piece focuses on how caching interacts with fast, decision-oriented model usage; technical details are in the original post.
More from Infra
- From "can you speak English?" to $1T: AMD's market cap rose 100x since 2018 — soumitrashukla9 · 2026-09-30
- Anthropic carries $252B in non-cancelable compute obligations plus $161.2B in Broadcom TPU leases — ns123abc · 2026-09-30
- Datacenter backlash accelerating: indexed YouTube videos up 4.8x in 30 days — zealcaiden · 2026-09-30
- Blackstone, KKR, Apollo put $5.3B into gas plants powering AI data centers — pstAsiatech · 2026-09-30
- 'Not from a neocloud': engineers mock GPU elasticity gaps of small cloud providers — charles_irl · 2026-09-30
- Lightning AI Hires CFO, CMO, CPO in Post-Voltage Park Push for Full-Stack AI Cloud — LightningAI · 2026-09-30