Teutonic-II-110B Announced: Exploring Loss-based Markets for Decentralized Training
markjeffrey · x · 2026-08-24
The Teutonic team released the 110B parameter Teutonic-II model, scaling 10x beyond their previous run.
Based on Bittensor Subnet 3, the core mechanism is a "loss-based market": instead of a committee picking the winning checkpoint, the decision is based on eval loss reduction. This experiment tests if decentralized competition can coordinate productivity and scale to 1T parameters. A link to the Teutonic-I 10B technical report is also included, detailing its "king-of-the-hill" competitive parallel training mechanism and benchmark performance.
Related event: Teutonic-II-110B Launches Record-Scale Decentralized Training(2 posts)→
More from Infra
- Technical Discussion: Is Quinary Quantization on the Pareto Frontier? — georgejrjrjr · 2026-08-25
- Grafana: The trade-off of focus at a time of platforms — thedealdirector · 2026-08-25
- How much VRAM do you really need to run 13B models locally? — close_Meal6005 · 2026-08-25
- IBM announces dual ISA processor supporting mainframe and ARM architectures — firstadopter · 2026-08-25
- Intel China Follows Bonsai on Quantization; Quinary Quantization Bet to be on Pareto Frontier — georgejrjrjr · 2026-08-25
- Debunking "Data Centers Only Serve Billionaires" — AIandDesign · 2026-08-25