GPT-2's 'all you really need': the decoder, prompting, and scale
ianand · x · 2026-09-20
ianand summarizes the key moment in our universe: GPT-2 took the decoder half of the Transformer and showed 'all you really need' is — the decoder, a single model for multiple tasks, prompting instead of task fine-tuning (the big unlock), and scale. This line gave rise to today's popular LLMs.
More from Research
- Jev reproductions tracker trends on Hugging Face Spaces — multimodalart · 2026-09-20
- GAVEL harness lifts Qwen3-8B from 41.2% to 91.8% on long-horizon robot tasks — dair_ai · 2026-09-20
- IIT Madras' AI4Bharat launches Indic LLM Arena to crowd-rank LLMs for Indian languages — heiga_zen · 2026-09-20
- LTX Video 2.5 Measured: 121-Second Single-Pass Generation, Resolution-Duration Equation Derived — Robotman2100 · 2026-09-20
- Laurent Younes' 2024 ML textbook now free to read on ChapterPal — burkov · 2026-09-20
- Nature paper: mammalian brain forms from two structures—hive minds may be real — juanbenet · 2026-09-20