Supervised vs self-supervised is a false dichotomy: RL is where it ends up
KyleMorgenstein · x · 2026-11-18
Kyle Morgenstein argues on X that "supervised vs self-supervised" is a false dichotomy — you're always training against some reference, even if that reference is a latent property of the dataset (e.g., contrastive methods). That's a fine way to bootstrap priors, but doing anything interesting with them will eventually require RL.
More from Research
- Eval methodology: statistical tests are valid, but conclusions must span prompt, judge, and harness variance — srchvrs · 2026-11-18
- RL lecturer shares lecture slides: supervised learning approximates, RL discovers functions — KyleMorgenstein · 2026-11-18
- "Supervised vs self-supervised" is a false dichotomy, argues UT RL lecturer — KyleMorgenstein · 2026-11-18
- ELLIS Sites NeurIPS Fest 2026 returns across Europe with 18 accepted NeurIPS papers — DocXavi · 2026-11-18
- Decompiled Instagram APK reveals on-device models and probing for 23 installed AI apps — ChenhaoTan · 2026-11-18
- Running a 180B MoE Model on a 16GB MacBook: Experts Offloaded to SSD, 14× Faster Than llama.cpp — XiongChenyan · 2026-11-18