Marin admits substantial benchmark contamination slipped past its decontamination pipeline

dlwh · x · 2026-11-18

The Marin team disclosed that they found substantial contamination from common pretraining benchmarks in Mochi 535B-A23B that their decontamination procedure failed to catch.

Following the release of 57 intermediate checkpoints, this is another transparency move — and a notable real-world case that decontamination pipelines can silently fail.

Original post →

More from Research

Research channel →