Marin releases 535B-A23B pretraining checkpoints, admits benchmark contamination slipped past decontamination

dlwh · x · 2026-11-18

The Open Athena team released Marin Mochi 535B-A23B on Hugging Face: intermediate pre-training checkpoints from the Hero run, with no instruction tuning or safety post-training.

Related event: Marin Releases All 57 Intermediate Checkpoints of 535B MoE Model(3 posts)→

Original post →

More from Models

Models channel →