OpenEuroLLM Proposes Complex KDA to Boost Linear RNN Expressivity

OpenEuroLLM researchers published Complex KDA (CKDA), an improvement to Kimi Delta Attention that uses complex-valued extensions and widened gating to let a single linear-RNN layer track more states, addressing the limited expressivity of delta-rule models compared to Gated Deltanet.

2026-09-22 ~ 2026-09-22 · 3 related posts

• Complex KDA: extending Kimi Delta Attention to 2D rotations for linear RNN expressivity — Yossarian_1234 · 2026-09-22
• Research explains Kimi Delta Attention expressivity, proposes Complex KDA with extended gate range — Yossarian_1234 · 2026-09-22

1 near-duplicate retellings: openeurollm