Cradle Codec: GPU-Native KV Cache Compression for Cross-Node Migration

Cradle Codec is a GPU-native KV cache compression technology designed to overcome cross-node transmission bottlenecks by bypassing NVLink in favor of Ethernet. It enables the efficient migration of inference states across accelerators, machines, and data centers.

2026-07-29 ~ 2026-07-29 · 3 related posts