60-Person Team Applies RSI to Frontier Pre-training, Trains 30B MoE in 3 Months
An arXiv paper claims the first application of recursive self-improvement (RSI) to a full frontier pre-training run: a 60-person team trained a 30B MoE from scratch in 3 months, reportedly outperforming Qwen3, while noting that pre-training makes RSI hard since runs cannot be repeated.
2026-11-19 ~ 2026-11-19 · 2 related posts
- RSI Comes to Frontier Pre-training: 30B MoE Trained From Scratch in 3 Months — burny_tech · 2026-11-19
- First RSI in Frontier Pre-training: 801-30B Beats Qwen3-30B After 3-Month Run — burny_tech · 2026-11-19