ianand's thread: Jev, an Encoder-based AI model from a parallel universe
ianand · x · 2026-09-20
ianand published a thread imagining 'Jev, an AI model from a parallel universe':
- History: the 2017 Transformer did one job (English-to-French translation) with an Encoder analyzing text and a Decoder producing output.
- Our universe: GPT-2 took the decoder half and showed 'all you really need' is the decoder, a single model for multiple tasks, prompting instead of task fine-tuning, and scale — giving rise to ChatGPT, Claude, Gemini and all popular LLMs.
- The parallel universe: no GPT-2 moment; the same innovation went into the Encoder, producing Jev.
- Jev's traits: faster, more predictable, more reliable — but can't code or chat, only make decisions. A 'decision AI' rather than generative AI.
- Key takeaway: Decoder self-supervised training scales easier, so maybe we were destined to build ChatGPT first; but Jev gives the Encoder a ChatGPT-equivalent product surface, and devs are rediscovering use cases for this 'decision AI'.
More from AGI Musings
- AI moves so fast the classic Gartner Hype Cycle needs recalibrating — dbreunig · 2026-09-20
- Ramez: my p(doom) is very low, but AI safety debates need more good faith — geoffreyirving · 2026-09-20
- Chamath predicts top three AI models will be open source within 12 months, with US clouds as winners — teortaxesTex · 2026-09-20
- Long-standing Catalan constant irrationality proof posted, claimed to be LLM-assisted — burny_tech · 2026-09-20
- Eleos AI announces second conference on AI consciousness and welfare, Berkeley 2026 — burny_tech · 2026-09-20
- Debate over low-guardrail agents: biggest AI upsides may also need autonomy — trevposts · 2026-09-20