Decentralized Network Trains 16B Model Across 3 Continents Using RTX 4090s
bittingthembits · x · 2026-07-29
The decentralized AI network $TAO has successfully trained the Orion-16B model across 256 heterogeneous GPUs, including RTX 4090s and 5090s, spanning three continents.
The project aggregates idle compute from independent global providers, coordinating machines with varying speeds and reliability to function as a single training system. With the training process publicly visible and contributors compensated for useful work, it demonstrates the viability of permissionless, decentralized compute networks for large-scale model training.
More from Infra
- Together AI adds canary rollouts for zero-downtime model upgrades on dedicated inference — togethercompute · 2026-09-23
- Dedicated Hardware for Running AI Agents at Scale Arrives — cyrilzakka · 2026-09-23
- Ternary Bonsai 2 27B: 5.9GB weights retain ~95% of full-precision reasoning — cephaloform · 2026-09-23
- Qwen 27B runs 24hr unattended on one RTX5090, builds full Postgres-SpringBoot-React spreadsheet app — anglepoiselife · 2026-09-23
- OpenRoboto Shift launches: decentralized egocentric video data network for robot brains — markjeffrey · 2026-09-23
- Engineer describes designing digital circuits that recycle most of their energy — MikePFrank · 2026-09-23