Project Orion Trains 16B Model Across Heterogeneous Compute on Three Continents

Macrocosmos has launched live distributed training for its 16B parameter Orion model across three continents. The experiment focuses on long-term training using heterogeneous compute, currently utilizing 4090s and 5090s, with plans to add more GPUs.

2026-07-28 ~ 2026-07-28 · 2 related posts

• Project Orion is training a 16B model live across three continents on heterogeneous compute — markjeffrey · 2026-07-28
• Macrocosmos starts a permissionless 16B model training run across three continents — markjeffrey · 2026-07-28