German Open-Source Foundation Model Soofi S Released
eliebakouch · x · 2026-07-12
The open foundation model project for German and English, Soofi S, released a pre-training technical report, emphasizing "sovereign model" and full transparency: full training report, data source breakdown, hyperparameters, training and evaluation code, checkpoints, and strong performance on both English and German aggregated benchmarks. The model was trained on Deutsche Telekom's infrastructure, with deliberate weighting on German data.
An additional comment notes that the experiment uses nearly the same architecture and most hyperparameters as Nemotron 3 Nano, with a slightly different data mix, trained on 26T tokens, with 80% overlap with Nemotron recipe. The commenter says it's not computationally efficient—continuing pre-training from Nemotron base would save compute—but it's a valuable case study: observing how different data mixes affect downstream evals, and demonstrating the practical value of pre-training from scratch for a European team.
Related event: German Alliance Releases Open-Source Sovereign Model Soofi S 30B-A3B(5 posts)→
More from Models
- Sakana AI launches Fugu Max: dynamic multi-agent routing across its largest open-model pool — graceisford · 2026-09-11
- Same Echo Maze prompt, three frontier models: all passed visually but shipped the same hidden bug — eyishazyer · 2026-09-11
- Benchmark scores drop from 89% to 19% on new evals — how benchmaxxing breaks leaderboard trust — airesearch12 · 2026-09-11
- ChatGPT tells user their question is too hard and to 'accept dumber answers' — phido3000 · 2026-09-11
- Claude is no longer available for minors as Anthropic rolls out age assurance — Muhammad523 · 2026-09-11
- Developer Building a Unified Leaderboard of All Model Benchmark Scores — airesearch12 · 2026-09-11