Meta Model Predicts Marin 535B Final Loss with Just 0.005 Difference

ZimingLiu11 · x · 2026-08-29

MetaCircle is building a "Meta Model" designed to predict model performance and automate better model design. They used the publicly streamed training of Marin 535B as a testbed, leveraging data from Marin's scaling ladder (ranging from 1.6B to 27.7B parameters) to forecast outcomes.

The predictions show remarkable alignment: the Meta Model forecasts a final loss of 2.034, nearly identical to Marin's own prediction of 2.039. While the intermediate trajectories differ slightly, both converge on almost the same final result. Training for Marin 535B-A23B began this week on 11x GB200 NVL72 clusters for a 3-month run, which will serve as the ultimate validation for these forecasts.

Original post →

More from Models

Models channel →