Kimi Linear Paper Introduces Efficient Linear Attention Architecture

Kimi's new research introduces Kimi Linear, an efficient and expressive attention architecture featuring a linear attention variant with forgetting mechanisms and cross-layer attention residuals.

2026-07-28 ~ 2026-07-28 · 3 related posts