First RSI applied to full pre-training: 801-30B-A3B trained from scratch in 3 months on 11.8T tokens

Xudong07452910 · x · 2026-11-13

SII-GAIR and Xinxu AI's paper "No Second Run" claims the world's first application of recursive self-improvement (RSI) to an entire from-scratch pre-training run, producing 801-30B-A3B-Base, a 30B-A3B MoE model.

Related event: First Recursive Self-Improvement Applied to Frontier Pre-training, Open-Sourced 30B Model Beats Qwen3(2 posts)→

Original post →

More from coding & agent

coding & agent channel →