OpenAI's Łukasz Kaiser on RL generalization: agent reasoning may generalize more than expected
lukaszkaiser · x · 2026-09-26
In a discussion with Yoav Goldberg, OpenAI researcher Łukasz Kaiser addressed whether strong model reasoning reflects targeted RL training or genuine generalization. His framing: what matters is finding domains with "enough good diverse tasks and a grader good enough" — arXiv lemmas being a good example.
Based on hands-on agent usage, he believes the models are "generalizing a fair bit," though he jokes he might just be a boring user. A substantive exchange on RL specialization vs. general reasoning.
Related event: Researchers Debate Where Frontier Models' Reasoning Comes From(12 posts)→
More from Models
- Gemini 4 Carbon matches predecessor's score but explores less, gets distracted — patience_cave · 2026-11-11
- Fable 5.2 takes MazeBench frontier, matches GPT-6 Astra puzzle-solving — patience_cave · 2026-11-11
- MazeBench: Fable 5.2 scores 15%, near-frontier at half price; Gemini 4 Carbon 11% — patience_cave · 2026-11-11
- ERNIE 5.5 Flash Preview enters LMArena Battle Mode for crowdsourced ranking — arena · 2026-11-11
- Blind tests: DeepSeek matches Opus on 95% of agentic loops at 40x lower cost — bindureddy · 2026-11-11
- Indie dev flips from $20 Pro back to $200 Gemini Ultra after two days of deep use — yihui_indie · 2026-11-11