Stanford launches Marin 535B training with full open process
soumitrashukla9 · x · 2026-08-22
Stanford CRFM announced the start of training for Marin 535B-A23B. The plan involves 80% pretraining and 20% midtraining on 18.75T tokens, utilizing 11 x GB200 NVL72 clusters for approximately 3 months (2.7e24 FLOPs).
To ensure stability for their largest run yet, the team trained a 4-rung scaling ladder (1.6B to 27.7B) to debug issues and forecast performance. The project upholds principles defined in their Mistral framework from 5 years ago: simplicity, community, flexibility, transparency, reproducibility, pedagogy, and scalability.
More from Infra
- Copper to optical: optical backplanes seen as necessary as racks move to optics — BenBajarin · 2026-10-16
- Polymarket prices 28% odds a US state enacts data center moratorium by year-end — Polymarket · 2026-10-16
- Pennsylvania residents reject $10,000-per-household offer for massive Amazon data center — Polymarket · 2026-10-16
- PyTorch now runs natively on AWS Trainium with zero code changes — PyTorch · 2026-10-16
- Chinese labs run on ~1/10 US compute; ByteDance pays 2-4x to hoover up SEA supply — robleclerc · 2026-10-16
- Zymtrace raises $12.2M and hires ML engineers to build agents that fix GPU bottlenecks — cfregly · 2026-10-16