Stanford Marin releases all 57 intermediate checkpoints of its 535B-A23B pretraining run

MaziyarPanahi · x · 2026-11-18

Stanford's Marin project has released all 57 intermediate checkpoints from pretraining its "Mochi" 535B-A23B model, including 10 from the long-context extension phase.

Open-sourcing the full checkpoint trajectory from a public research team is rare and valuable for scaling studies, loss-curve analysis, and ablation work — community members are calling it gold for open research.

Original post →

More from Models

Models channel →