Training compute cost per task may be mere cents, argues 1a3orn — if models generalize from small runs

1a3orn · x · 2026-11-22

1a3orn argues the compute cost per task during training is likely in the cents — possibly fractions of a cent, or under a dollar — with a key caveat: this assumes models learn facts about large runs from much smaller runs. He compares it to math models, where training cost per task and the cost of using them to prove something like RH are separate quantities.

Original post →

More from AGI Musings

AGI Musings channel →