Back to 2017: the Transformer was born to translate English to French
ianand · x · 2026-09-20
In his thread, ianand revisits 2017: the Transformer had only one job — translating English to French. Simplified, it consisted of an Encoder that analyzed the text and a Decoder that produced the output, the origin of the encoder/decoder split.
More from Research
- Researcher urges papers to show actual training data samples, cites his CVPR24 practice — gabriberton · 2026-09-20
- Self-Rewarding LLMs isn't news: RLAIF has long been standard practice — burny_tech · 2026-09-20
- Long-standing Catalan constant irrationality proof posted, claimed to be LLM-assisted — burny_tech · 2026-09-20
- Brain Runs on 20 Watts: Can Neuromorphic Computing Make AI Less Power-Hungry? — burny_tech · 2026-09-20
- Amid the AI math proof debate, a curated set on proofs across generations — RexDouglass · 2026-09-20
- Four LLMs play Doom: Jev leads with 5.63 mean kills but 15x higher latency — shniydder · 2026-09-20