AI2 open-sources Olmo-core 3, a MoE training stack scaling to trillion parameters

lmoroney · x · 2026-10-03

The Allen Institute for AI open-sourced Olmo-core 3, a PyTorch training stack for MoE models up to the trillion-parameter range.

Related event: Ai2 Open-Sources Olmo-core 3, a Trillion-Parameter MoE Training Stack(5 posts)→

Original post →

More from Infra

Infra channel →