Orion-16B passes 100B tokens, largest LLM pretrained with decentralized compute
const_reborn · x · 2026-08-15
Orion-16B has surpassed 100B training tokens and continues to improve. It is the largest LLM pretrained using DPP, reaching 10^22 FLOPS with heterogeneous commodity GPUs from permissionless global providers. The team plans to add new GPU types and scale to 256 GPUs next week.
More from Infra
- Macro Analysis: Is the AI Dip a Buy? Key Levels to Watch — Beth_Kindig · 2026-08-15
- Sanders Threatens AI Pause, Nvidia Partners with Wall St on Compute-Backed Securities — PeterDiamandis · 2026-08-15
- Fireship: How edge ML cameras built a warrantless tracking network — Fireship · 2026-08-15
- Qwen Official Guide: Tuning reasoning depth and extending context to 1M tokens — solyarisoftware · 2026-08-15
- DeepSeek V4 Pro Requires Linux/WSL to Function Properly — teortaxesTex · 2026-08-15
- Tiny-Qwen update: PyTorch-native build for Qwen 3.8 27B model — No-Compote-6794 · 2026-08-15