60-Person Team Applies RSI to Frontier Pre-training, Trains 30B MoE in 3 Months

An arXiv paper claims the first application of recursive self-improvement (RSI) to a full frontier pre-training run: a 60-person team trained a 30B MoE from scratch in 3 months, reportedly outperforming Qwen3, while noting that pre-training makes RSI hard since runs cannot be repeated.

2026-11-19 ~ 2026-11-19 · 2 related posts