Tim Dettmers teases bitsandbytes2 with lazy compression for near-infinite KV cache

Tim_Dettmers · x · 2026-09-22

Tim Dettmers announced a slight delay to bitsandbytes2, now part of an upcoming open-source week releasing an entire ecosystem.

The headline feature is lazy compression: a technique requiring zero user configuration that always yields an optimal memory-quality-speed trade-off when deploying any model, even as the KV cache grows. Combined with another technique releasing the next day, it enables virtually infinite KV cache.

He credited students Eulrang Cho, Trang Nguyen, and Christine Park for their patience in holding back the releases.

Related event: bitsandbytes2 Slightly Delayed, Promising Near-Infinite KV Cache(2 posts)→

Original post →

More from Infra

Infra channel →