Russia's Sberbank Releases GigaChat Using MLA+GDN

teortaxesTex · x · 2026-07-06

Russia's Sberbank's latest GigaChat model adopts the MLA+GDN attention mechanism, with 432B parameters and 28B activated. It is jokingly called the homegrown Kimi K3. Its base model has been open-sourced (MIT license). Compared to V4-Flash, the author believes its performance is average but better than expected for Russia.

Related event: Sberbank Releases Open-Source GigaChat 3.5(3 posts)→

Original post →

More from Models

Models channel →