Teknium: switching models mid-session invalidates your prompt cache, pay full input price again
adrianscottcom · x · 2026-08-26
Teknium of Nous Research warns that if you keep switching models within a session, each switch invalidates the entire prompt cache on the new model, forcing you to repay the full input-token price for the whole context. Unless the models are free, stop doing this — it is a fundamental of inference, not a quirk of any specific model.
Related event: Teknium: Switching Models Mid-Session Kills Prompt Caches and Doubles Costs(4 posts)→
More from coding & agent
- Teknium ships official Hermes Agent plugin for one-install reverse engineering of any app — alexcovo_eth · 2026-10-16
- Claude eng lead Felix Rieseberg publishes tutorial on being more ambitious with AI — danshipper · 2026-10-16
- Qwen Code Desktop v0.25.2 ships managed-agent fixes and MCP config repair — github-actions[bot] · 2026-10-16
- NVIDIA makes 7 AI agent courses free, from agent basics to securing agents — ifioknkem · 2026-10-16
- Claude runs 9-hour task, then stalls waiting for Drive permission — juliey4 · 2026-10-16
- vegaml ships a full open-source toolbelt: cascaded inference, calibration, MCP server — kalyan_kpl · 2026-10-16