Can same-family models share warm cache? Reddit debates mid-conversation model switching costs

rapPayne · reddit · 2026-11-20

On Reddit, rapPayne cites an edgee.ai article framing mid-conversation LLM switching as a ski-rental problem: every prompt resends full context, and switching models invalidates the warm cache, making 100% of context new and expensive.

His open question: can models within the same vendor family share cache? Since each model has its own tokenizer, could vendors force a shared tokenizer during training or build a common mid-level tokenizer so warm cache survives model switches? No answer yet — an open discussion.

Original post →

More from coding & agent

coding & agent channel →