A single timestamp can break your coding agent's prefix cache, Ollama and Together explain
zainhas · x · 2026-11-17
Ollama and Together's joint post explains why coding agents like Claude Code, Codex and Pi stay fast: agents resend the whole conversation each turn, so prefix caching only works if both harness and inference engine do their part. Key lessons: a single timestamp in the system prompt can break the cache; changing reasoning effort wipes it entirely; telling the agent its output was truncated makes it read what it missed.
Related event: Together AI and Ollama Explain How Prefix Caching Keeps Coding Agents Fast(3 posts)→
More from coding & agent
- Claude Code demolished Microsoft's decade-long VS Code strategy in under 6 months, says Gergely Orosz — rickasaurus · 2026-11-17
- Personal agent checks email every 5 minutes on DeepSeek V4.1 Flash at near-zero cost — alexcovo_eth · 2026-11-17
- AI-generated code passes all tests but is riddled with opaque contracts, finds Stanford professor's review — RobbWiller · 2026-11-17
- Riley Brown: After 50+ DMs, Nothing Beats Claude Code Projects Right Now — angrypenguinPNG · 2026-11-17
- MCP server turns your saved reels and posts into searchable notes for Claude — PaRtHuS · 2026-11-17
- Stardock CEO shows agents building games across PCs and Macs, with hard-won engineering lessons — draginol · 2026-11-17