LongCat 2.0 Open Source: 1.6T Param MoE, ~48B Active

eliebakouch · x · 2026-07-05

LongCat 2.0 model weights are open-sourced under the MIT license, featuring approximately 1.6T total parameters and 48B active parameters. Compared to its predecessor, it keeps the attention shape unchanged but reduces the number of experts from 256 to 128, while adding 135B embedding parameters and an n-gram mechanism. This design choice of "reducing the number of experts" runs counter to conventional practices.

Related event: LongCat 2.0 Open-Sourced: 1.6T Parameter MoE Model(3 posts)→

Original post →

More from Models

Models channel →