Soofi S Releases 30B Hybrid Mamba Open-Source Model

Soofi S released the full pretraining report for its 30B-A3B MoE hybrid Mamba model. Trained on 27 trillion tokens, the open-source model claims leading performance in German-English bilingual evaluations.

2026-07-21 ~ 2026-07-23 · 2 related posts

Full story(3 episodes)→