Iota says Orion-16B is training live on unreliable compute across three continents
markjeffrey · x · 2026-07-28
Iota says it is training a 16B model on unreliable, distributed compute across three continents
Macrocosmos AI says a 16-billion-parameter model, Orion-16B, is now training live on IOTA’s distributed network.
- The setup spans three continents and uses heterogeneous, permissionless compute owned by no single entity.
- The key engineering claim is resilience: training computers can drop in and out, and the run keeps going.
- The post frames this as the next stage of Project Orion, with more details promised on the systems, providers, and engineering behind the training stack.
More from Infra
- fmgo: call Apple's on-device Foundation Models from Go with no CGO and no Swift — Super_Run_8466 · 2026-09-23
- Huawei unveils Peerium architecture: nested BSP unifies million processors into one computer — Dr_Singularity · 2026-09-23
- Grok explains why DeepSeek picked DualPipe + ZeRO-1 over ZeRO-3 on 2048 H800s — TheZachMueller · 2026-09-23
- AI costs fall 47% per quarter, 4x faster than DNA sequencing: Epoch AI — daveholtz · 2026-09-23
- M5 Ultra LLM test: 4x faster prompt processing, but double the power draw — DigitalguyCH · 2026-09-23
- $500 of Dell OptiPlexes become a diskless netboot lab where AI agents can't brick the hardware — colinmcnamara · 2026-09-23