Complex KDA Extends Kimi Delta Attention with 2D Rotary Representation

OpenEuroLLM researchers published Complex KDA, which compares the expressive power of Gated Deltanet and Kimi Delta Attention and extends KDA's gating range to achieve a 2D rotary representation.

2026-09-22 ~ 2026-09-22 · 2 related posts

• Complex KDA: extending Kimi Delta Attention to 2D rotations for linear RNN expressivity — Yossarian_1234 · 2026-09-22
• Research explains Kimi Delta Attention expressivity, proposes Complex KDA with extended gate range — Yossarian_1234 · 2026-09-22