Stanford's Marin 535B Model Training Starts with Full Transparency
udmrzn · x · 2026-08-24
Stanford professor Percy Liang announced the start of training for the new Marin 535B-A23B model, opening the entire process to the public. The model features 535B total parameters (23B active), trained on 18.75T tokens using 11 GB200 NVL72 clusters (approx. 792 GPUs) for an estimated 3 months and 2.7e24 FLOPs. Prior to the main run, the team completed a 4-rung Scaling Ladder (from 1.6B to 27.7B) to debug and forecast training behavior. The public can now monitor real-time training curves and logs, marking this as potentially the largest openly observed model training run to date.
Related event: Stanford's Marin Launches Fully Transparent Training of 535B Model(7 posts)→
More from Infra
- AMD Instinct MI210 for Local LLMs: A Cost-Effective Choice? — OvertaxedOne · 2026-08-24
- Wells Fargo sees Broadcom AI chip revenue at $205B by FY28, far above consensus — Beth_Kindig · 2026-08-24
- Disaggregated LPDDR memory: A new path for AI infrastructure — jwt0625 · 2026-08-24
- Study notes: how speculative decoding accelerates LLM inference without quality loss — helloiamleonie · 2026-08-24
- Global AI Power Demand Projected to Surge 1,100% by 2033 — KyeGomezB · 2026-08-24
- RTX 3080 Memory OC to +1200 Boosts Flux Generation Efficiency — MakionGarvinus · 2026-08-24