Stanford launches Marin 535B training with full open process
soumitrashukla9 · x · 2026-08-22
Stanford CRFM announced the start of training for Marin 535B-A23B. The plan involves 80% pretraining and 20% midtraining on 18.75T tokens, utilizing 11 x GB200 NVL72 clusters for approximately 3 months (2.7e24 FLOPs).
To ensure stability for their largest run yet, the team trained a 4-rung scaling ladder (1.6B to 27.7B) to debug issues and forecast performance. The project upholds principles defined in their Mistral framework from 5 years ago: simplicity, community, flexibility, transparency, reproducibility, pedagogy, and scalability.
Related event: Stanford Starts Fully Open Training of 535B-Parameter Marin Model(2 posts)→
More from Infra
- Data center water use: 10GW hyperscaler consumes 120B gallons annually — SumitGup · 2026-08-22
- OpenBot: Open-source AI Coworkers with Isolated Containers and Policy Gateways — aigclink · 2026-08-22
- MiniMax-H3 INT8 Release: Why Keep FC2 in BF16 — marres · 2026-08-22
- Nuclear 'hot rock' generates immense energy vs weak passive solar needing maintenance — tawnniee · 2026-08-22
- 2-4K GPUs can serve 100T tokens daily, sparking efficiency debate — teortaxesTex · 2026-08-22
- Prediction market opens on whether Apple will announce 1TB+ unified memory chip — benfielding · 2026-08-22