RSI Comes to Frontier Pre-training: 30B MoE Trained From Scratch in 3 Months

burny_tech · x · 2026-11-19

A repost of the arXiv paper No Second Run: Does RSI Stop at Frontier Pre-training? — see the companion post with the full abstract for details.

Related event: 60-Person Team Applies RSI to Frontier Pre-training, Trains 30B MoE in 3 Months(2 posts)→

Original post →

More from Research

Research channel →