AI training efficiency could make the same capability 1,000x cheaper in 10 years
natolambert · x · 2026-07-24
The argument here is that the right analogue to Moore’s law for AI is not scaling laws, but the year-over-year gains in intelligence efficiency from using models to help train models.
If training efficiency improves 2x every year, then a fixed performance level would become 32x cheaper in 5 years and 1,000x cheaper in 10 years. The implication is that intelligence could eventually behave like a commodity, similar to electricity, even if scaling the biggest models keeps helping.
More from AGI Musings
- Sam Altman says the US should win AI on both open source and proprietary models — soumitrashukla9 · 2026-07-25
- How much AI energy use actually translates into meaningful human progress? — francoisfleuret · 2026-07-25
- The real breakthroughs in AI may still be ahead, and physics has not been fully tapped — MaxUnfried · 2026-07-25
- A post revisits the case for open science and the politics of intellectual property — tokenbender · 2026-07-25
- Reddit asks where AI is surprisingly bad, not just impressive — PROfil_Official · 2026-07-25
- Frontier models can be superhuman on one task and fail hard on the next — nicolascraske · 2026-07-25