Marin Releases All 57 Intermediate Checkpoints of 535B MoE Model

Marin has open-sourced all 57 intermediate checkpoints of its Mochi 535B-A23B MoE pretrained model on Hugging Face, covering an 18.2T-token training run, while acknowledging unresolved benchmark contamination.

2026-11-18 ~ 2026-11-18 · 3 related posts