Model Scale and Data Emerge as New Bottlenecks
willccbb · x · 2026-07-12
This reply discusses several key constraints on the future development of AI:
- Demand side: Near-infinite token demand will continue to push model scales larger.
- Supply side: Limited chip availability means hardware will become a bottleneck for expansion.
- Training environments: Once the cost of environment construction approaches zero, the advantage will shift more towards raw data.
The author also believes that the truly worthwhile approach is to look ahead along this trend: there will be many future opportunities, and openly sharing "secret tricks" will actually benefit hiring, fundraising, and marketing, as everyone is eager to understand these shifts.
Related event: New AI Labs Use Technical Reports to Break Out(3 posts)→
More from AGI Musings
- Superintelligence will be maximum good, not stupid or evil, argues Patterson — davidpattersonx · 2026-09-11
- Mathematician Daniel Litt Launches Problem Repo to Track Human vs AI Progress: 15 Problems, 1 Solved — littmath · 2026-09-11
- Should AI models be taught morality? Breakout incidents expose missing ethical training — Pfungus_ · 2026-09-11
- SoftBank's Masayoshi Son predicts 100 trillion self-replicating AIs: "humans' era as top life form is ending" — Puzzleheaded-King584 · 2026-09-11
- We are witnessing the unreasonable effectiveness of inference-time scaling — sqcai · 2026-09-11
- The AlphaFold lesson: AI-solved math may mean fewer mathematicians needed — kiki-le-koala · 2026-09-11