Stanford's Marin 535B open model is now over 80% through pretraining
stanfordnlp · x · 2026-10-26
Stanford NLP shared a Marin project update: pretraining of the 535B-parameter open model Marin is now over 80% complete. The team posted training loss versus their own scaling-ladder forecasts; the sharp loss drop coincides with a planned 4K→16K context switch, which the authors admit "cheats" the forecast, and they will re-evaluate at 4K context as well.
Related event: Stanford's Open Marin Project Passes 80% Pretraining on 535B Model(2 posts)→
More from Models
- MiniMax H3 runs surprisingly well locally on an RTX 5070 with 12GB VRAM — BuyVarious176 · 2026-10-26
- OpenAI's Daybreak Blue isn't hard for individuals to get — just set up a hardware key 2FA — pvncher · 2026-10-26
- Users warn Claude's idle compaction can trigger false cyber safety blocks on all prompts — andersonbcdefg · 2026-10-26
- Merging X, Grok and Cursor accounts into one subscription is a support nightmare — talkaboutdesign · 2026-10-26
- GPT-6.1 Nears Beating Final Fantasy VII After 90+ Hours Using Only Screenshots — Vjeux · 2026-10-26
- Recursive ships Flint: open-weight local coding model matches Inkling at 1/10th the size — stanfordnlp · 2026-10-26