Challenging Transformers: European AI Startups Race for Next-Gen LLM Engines
nordicinst · x · 2026-08-10
MIT Technology Review points out that while the Transformer architecture underpins the entire AI industry, it is showing its age, relying on workarounds for long context and reasoning. The article explores the emerging generation of LLM technologies (dubbed LLM+).
AI startups in Europe, particularly in Sweden and the EU, are racing to develop alternatives that outpace Transformers. These new directions include sparse attention, liquid AI, diffusion LLMs, and state-space models, aiming to build smarter, cheaper, and greener LLM engines.
More from Companies & People
- Wayve AI Founder to Share Contrarian Embodied AI Ideas at Actuate26 — alexgkendall · 2026-08-10
- Romania Ranks 4th at the International Olympiad in Artificial Intelligence — alexvoica · 2026-08-10
- Building an Agent Software Factory: Visualizing Human-Agent Workflows — Hopeful-Fly-5292 · 2026-08-10
- Zuckerberg Outlines Meta's Open Source Philosophy, Advocates for Personal Superintelligence — alexandr_wang · 2026-08-10
- Kavak Rebuilt Itself Around AI Agents: 96% of Interactions Automated — a16z Podcast · 2026-08-10
- Startups Target Transformer Bottlenecks with New LLM Architectures — MIT Tech Review AI · 2026-08-10