Attention co-author Lukasz Kaiser: power concentration is a Transformer property, not AI's fate
lukaszkaiser · x · 2026-09-02
OpenAI researcher and Attention Is All You Need co-author Lukasz Kaiser, speaking at the Open Source AI Summit, argued he's optimistic AI can stay open: "power concentration is a property of the Transformer, not a permanent feature of AI."
His reasoning: humans are the world's best computers, yet there is no single giant human brain — just many separate individuals. Given fixed data, many distributed models that are individually strong and stronger together may learn better, supported by ensemble research. Transformers need the whole internet, but an even better algorithm that learns from much smaller data likely exists.
The same series covers why a former Linux Foundation AI CTO thinks China leads on open weights, and Fireworks AI's CTO on companies owning their intelligence.
More from AGI Musings
- Anthropic borrows lawyers' ethics for Claude agents that closed 186 deals with no human approval — rohanpaul_ai · 2026-10-18
- Researcher argues we may solve AI-human alignment before humans align with each other — 3scorciav · 2026-10-18
- EigenGender: private-industry coup isn't the default, but worth guarding against — EigenGender · 2026-10-18
- Writing instructor's meltdown: "LLMs are literally just spicy autocomplete" — Decent-Decision-9028 · 2026-10-18
- When will a machine win a Nobel Prize? — rand_longevity · 2026-10-18
- If humans had a chain of thought, most would fail alignment training — robleclerc · 2026-10-18