How the movie Arrival inspired Illia Polosukhin's idea for self-attention
dosco · x · 2026-10-13
A piece of AI lore: in 2016, Google's Illia Polosukhin was stuck on how machines should process language. The film Arrival — heptapods writing whole meanings in circular inkblots — sparked the shift: let the model see the whole text at once and decide which words relate. That idea became self-attention, the core of the Transformer.
More from Fun
- Claude Opus 5.5 maps 5,285 km coast-to-coast US route, sampled every 10m — garrytan · 2026-10-13
- Moving day, deep sea edition: AI-generated steampunk crab carries a manor — lukmanfebrianto · 2026-10-13
- A near-photorealistic AI portrait that's easy to mistake for a real photo — jordanbayne · 2026-10-13
- Stunning AI-generated chrome sculptures showcase state-of-the-art metal and glass rendering — adamho · 2026-10-13
- Andrew Carr: everyone praises Alex while Nat's critical role goes ignored — andrew_n_carr · 2026-10-13
- Dev who made $20k in 3 days jokes he has no idea what 'Jev' is — clients still pay — aryanXmahajan · 2026-10-13