Yoav Goldberg: I can't explain how today's long LLM reasoning traces emerged
odedbendov · x · 2026-09-25
AI researcher Yoav Goldberg says current LLM reasoning traces are 'too good' for him to explain: even with initial CoT abilities and billions of rollouts, he lacks a mental model of how such capabilities emerge from RL training. His best guess is massive spending on human-produced examples followed by SFT. Oded Bendov pointed to a video demystifying the full stack, but Goldberg notes it explains DeepSeek R1-era short reasoning — not the leap to today's long, complex chains.
Related event: Researchers Debate Where Frontier Models' Reasoning Comes From(12 posts)→
More from AGI Musings
- Kai-Fu Lee's Fortune Interview Debunks 3 Misconceptions About China's AI — kaifulee · 2026-11-11
- "Deep Learning is a search algorithm, not a learning algorithm" — JosephJacks_ · 2026-11-11
- AI-assisted proof shows no voting rule beats Borda on strategyproofness — conitzer · 2026-11-11
- The new PhD playbook: build a benchmark, earn frontier-lab recognition, then raise money for a data startup — teortaxesTex · 2026-11-11
- Ethan Mollick: GTA 6 Will Be the Last AAA Game Built Without AI — emollick · 2026-11-11
- Air Street Capital founder: AI is 'a museum of the mind' preserving human know-how — nathanbenaich · 2026-11-11