The parallel universe with no GPT-2 moment where innovation went to the Encoder
ianand · x · 2026-09-20
ianand imagines a parallel universe with no GPT-2 moment, where all the same technical and product innovation was poured into the Encoder half of the Transformer instead — giving rise to Jev, the core premise of his thread.
More from Research
- Researcher urges papers to show actual training data samples, cites his CVPR24 practice — gabriberton · 2026-09-20
- Self-Rewarding LLMs isn't news: RLAIF has long been standard practice — burny_tech · 2026-09-20
- Long-standing Catalan constant irrationality proof posted, claimed to be LLM-assisted — burny_tech · 2026-09-20
- Brain Runs on 20 Watts: Can Neuromorphic Computing Make AI Less Power-Hungry? — burny_tech · 2026-09-20
- Amid the AI math proof debate, a curated set on proofs across generations — RexDouglass · 2026-09-20
- Four LLMs play Doom: Jev leads with 5.63 mean kills but 15x higher latency — shniydder · 2026-09-20