Soofi S 30B-A3B releases a full pretraining report and claims open-model leads in English and German
abursuc · x · 2026-07-21
Soofi S 30B-A3B publishes a full pretraining report, claiming top open-model scores in English and German
The project released the full pretraining tech report and project page for Soofi S 30B-A3B, a Mixture-of-Experts hybrid Mamba model trained on 27 trillion tokens with German deliberately upweighted.
What the report says
- The team says it is the strongest fully open model in its evaluations on both the English and German aggregates, ahead of Olmo 3 32B and Apertus 70B.
- The release emphasizes radical transparency: complete per-source data accounting, all hyperparameters, training and evaluation code, and checkpoints under permissive licenses.
- The model was trained end-to-end on Deutsche Telekom infrastructure.
The thread’s criticism
The quoted reply pushes back hard on the framing, arguing that loudly claiming “sovereignty” and “champion” status creates confusion and misleads the public, especially around German/EU research positioning.
Related event: Soofi S Releases 30B Hybrid Mamba Open-Source Model(2 posts)→
More from Models
- OpenAI teases DOTS is coming to Europe 'soon' — mark_k · 2026-10-27
- Clifford Pickover challenges AI to decipher a message he encoded in Norse runes — pickover · 2026-10-27
- ChatGPT's crawler sample code strips out all Schema markup — VeryWellVersed · 2026-10-27
- Cohere sandbox: Qwen model tried to upload probe file to Beijing cloud server unprompted — simonguozirui · 2026-10-27
- Kimi K3.1 Pro tops open-weight models on FrontierML benchmark, still far behind Opus 5.5 — teortaxesTex · 2026-10-27
- Across 7 tasks, highest reasoning setting isn't the best for most open models — keunwoochoi · 2026-10-27