German Open-Source Foundation Model Soofi S Released
eliebakouch · x · 2026-07-12
The open foundation model project for German and English, Soofi S, released a pre-training technical report, emphasizing "sovereign model" and full transparency: full training report, data source breakdown, hyperparameters, training and evaluation code, checkpoints, and strong performance on both English and German aggregated benchmarks. The model was trained on Deutsche Telekom's infrastructure, with deliberate weighting on German data.
An additional comment notes that the experiment uses nearly the same architecture and most hyperparameters as Nemotron 3 Nano, with a slightly different data mix, trained on 26T tokens, with 80% overlap with Nemotron recipe. The commenter says it's not computationally efficient—continuing pre-training from Nemotron base would save compute—but it's a valuable case study: observing how different data mixes affect downstream evals, and demonstrating the practical value of pre-training from scratch for a European team.
Related event: German Alliance Releases Open-Source Sovereign Model Soofi S 30B-A3B(5 posts)→
More from Models
- Open-source labs could distill a state-of-the-art model to 32GB or 80GB VRAM, the post argues — bookwormengr · 2026-07-21
- Moonshot pauses Kimi K3 signups five days after launch as GPU demand surges — eyishazyer · 2026-07-21
- AI Diplomacy demo makes agents negotiate, ally, and betray each other — jamdac · 2026-07-21
- Newer models need a different prompting style, and old tricks can make outputs worse — emollick · 2026-07-21
- GLM-5.5 is said to arrive in 4 weeks with open weights — tanay_mehta · 2026-07-21
- Fable 5 is credited with a 3-variable counterexample to the Jacobian conjecture — Various-Affect4841 · 2026-07-21