801-30B-A3B tech report: decomposed pretraining self-improvement loops on 11.8T tokens

jiqizhixin · x · 2026-11-21

SII and Xinxu AI release 801-30B-A3B-Base with an official technical report on how to improve a pretraining run you can't afford to repeat.

Original post →

More from Infra

Infra channel →