Back to 2017: the Transformer was born to translate English to French
ianand · x · 2026-09-20
In his thread, ianand revisits 2017: the Transformer had only one job — translating English to French. Simplified, it consisted of an Encoder that analyzed the text and a Decoder that produced the output, the origin of the encoder/decoder split.
Related event: ianand's Thought Experiment: An AI World Built on the Encoder(9 posts)→
More from Research
- Study: Reflective Data Center Roofs Actually Cool Daytime Ground by 1.8-2.2°C — SumitGup · 2026-11-12
- Tsinghua's BaGuaLu-2 tames MoE expert-load spikes at runtime, accepted to SC26 — jiqizhixin · 2026-11-12
- Good Paper Writing Earns Genuine Praise, Don't Let the Meme Mislead You — Pseudomanifold · 2026-11-12
- HT-Policy Uses Heavy-Tailed Student-t Regression to Close Robot Policy Gap — chris_j_paxton · 2026-11-12
- Runway releases Praxis-1: video-trained world action model tops NVIDIA RoboLab-120 — graceisford · 2026-11-12
- Google's Physical-Engineering's Last Exam: all 14 frontier models score below 50% — dl_weekly · 2026-11-12