Imitation Learning vs RL Distribution Shift Debate
ftm_guney · x · 2026-07-15
The author believes that everyone advocates adding RL on top of imitation learning to solve distribution shift; but in reality, imitation learning agents like TFv5/6 and DrivoR still dominate in open benchmarks. He thus asks: is the so-called 'distribution shift' problem that RL claims to solve really as severe as people say?
Related event: Why imitation learning still tops RL on benchmarks(2 posts)→
More from Research
- OpenForecaster uses daily news to improve language-model forecasting — Cohere_Labs · 2026-07-21
- SenseTime unveils U1 Pro and open-sources a 50M-sample vision dataset at WAIC 2026 — 机器之心 · 2026-07-21
- Baseten study finds new facts in LLM weights are fragile unless trained from many restatements — alex_verem · 2026-07-21
- Kimi K3 and Fable 5 now look much closer than the old open-vs-closed gap — FinanceYF5 · 2026-07-21
- uv-scripts/ocr returns to the top of Hugging Face datasets with a JSON model picker — vanstriendaniel · 2026-07-21
- DeepSearch-World trains web agents with 420K verifiable QA tasks — HKUST · 2026-07-21