Bahdanau cooked edge transformers years before 2-simplicial, says _arohan_
_arohan_ · x · 2026-10-04
Quoting a Periodic Labs member's anecdote about weekly midtraining meetings alongside the inventor of attention and the trainer of the first trillion-param LLM, arohan calls Bahdanau the GOAT, noting he came up with edge transformers years before 2-simplicial attention gained attention. Post includes a hiring plug.
More from AGI Musings
- Anthropic's Sholto Douglas: AI capex could hit $4T by 2028 and double GDP by early 2030s — ziv_ravid · 2026-10-04
- Proposal: an 'Agenthood' legal identity letting AI agents be sued, taxed, and granted rights — micoolcho · 2026-10-04
- Why LLMs suddenly excel at math and cybersecurity still has no predictive theory — burny_tech · 2026-10-04
- Le Monde: the AI-pocalypse is a mirage distracting us from unsustainable AI development — marigo · 2026-10-04
- Cognitive-science abstractions transfer to AI: why Anthropic's interpretability looks psychological — sreejan_kumar · 2026-10-04
- Christian Szegedy writes 'Quo Vadis, Mathematics?' on math's future in the AI era — ChrSzegedy · 2026-10-04