Ant Group's Ling team shows how to train a 290B model without relying on expensive GPUs

aftahi_ai · x · 2026-11-17

Ant Group's Ling team explains how they trained a 290B-parameter model without fully relying on expensive GPUs, via smarter architecture, hardware optimization, and better training strategies. The attached loss curves compare loss-fixing variants (micro batch-size, NormHead, NormHead grad, correct loss), showing the fixed loss trains markedly lower and more stable — making large-scale AI far cheaper to build.

Original post →

More from Infra

Infra channel →