Marin Releases All 57 Intermediate Checkpoints of 535B MoE Model
Marin has open-sourced all 57 intermediate checkpoints of its Mochi 535B-A23B MoE pretrained model on Hugging Face, covering an 18.2T-token training run, while acknowledging unresolved benchmark contamination.
2026-11-18 ~ 2026-11-18 · 3 related posts
- Marin releases all 57 intermediate checkpoints of 535B-A23B MoE trained on 18.2T tokens — dlwh · 2026-11-18
- Marin releases 535B-A23B pretraining checkpoints, admits benchmark contamination slipped past decontamination — dlwh · 2026-11-18
- Stanford Marin open-sources all 57 intermediate checkpoints of 535B-A23B pretraining run — samsja19 · 2026-11-18