NLP researcher: models doing tasks well mostly means they trained on such tasks
ziv_ravid · x · 2026-11-03
Replying to Yoav Goldberg, the author pushes back on hype around OpenAI model experiments, saying there is "no magic": if models can perform certain tasks, it mainly signals they were trained on similar tasks. This reveals more about the type and scale of OpenAI's training data than about any general AI genius. The author adds that when you look at the details, most tasks described in the original post are… (thread truncated).
More from Models
- Victor Taelin floats labs replacing backprop with models editing their own weights at scale — arthurcolle · 2026-11-03
- Custom fine-tunes now beat frontier models at ~1/20th the cost, says investor — bindureddy · 2026-11-03
- OpenAI updates Model Spec: intent over literal instruction-following — sven_ai · 2026-11-03
- Zyphra's ZHA brings subquadratic attention via hierarchical tree-structured indexer — yacineMTB · 2026-11-03
- LiquidAI's LFM3-1.7B tops HF trending with 1k likes and 42.4k downloads in 5 days — maximelabonne · 2026-11-03
- 'Gemini is your friend and alignment is complicated': another eyebrow-raising model reply — vedantmisra · 2026-11-03