Triangle Launches Cross-Model KV Cache Transfer, Up to 10.8x Faster TTFT at 1M Context

ycombinator · x · 2026-11-17

OneTriangle announced cross-model KV cache transfer: prefill on a small model, transfer the KV cache, decode on a large one — up to 10.8x faster time-to-first-token at 1M context. SDK is live for Qwen3.5-4B → Qwen3.8-27B, with beta open for more model pairs.

Original post →

More from Infra

Infra channel →