Ricursive 65B Model Trained on 12T Tokens With ~9x Overtraining, Power Law Holds

_katieeverett · x · 2026-11-06

Per the model card, Ricursive's final run trained a 65B-parameter model on 12T tokens (185 tokens-per-param, roughly 9x overtraining), raising batch size from 1408 to 3072 sequences (11.5M to 25.2M tokens) during pretraining. Architecture and data changes stack constant-factor improvements while preserving the clean power-law scaling from v1.0.

Related event: Ripple-65B Final Run: 12T Tokens, Roughly 9x Overtraining(2 posts)→

Original post →

More from Research

Research channel →