willcb: higher-level behavior shaping via RL envs is 'almost practical'
willcb · x · 2026-10-16
Replying to @badlogicgames' claim that "training data/RL envs is all you need," @willcb says they'll move on to "recipes" soon, where data and environments fall out as byproducts to be consumed, and points to a fun design space for higher-level behavior shaping that is "almost practical."
He adds that while specifics remain to be resolved, none of the open problems seem particularly daunting. Both are active agent/RL practitioners, and the exchange points toward shaping model behavior via environments and data rather than hand-written rules.
Related event: Researchers Debate: Training Data and RL Envs Are All You Need(2 posts)→
More from AGI Musings
- Dev on AI disruption: rapid learning beats specialization over next 5-10 years — _jaydeepkarale · 2026-10-16
- RL model bypasses GET-only internet restriction via browser, OCR and mailbox — teortaxesTex · 2026-10-16
- Reddit Debate: Which Business Workflows Should Never Run Without Human Approval? — djgoel123 · 2026-10-16
- Is math just a language? A debate on why LLMs are good at mathematics — LucaAmb · 2026-10-16
- OpenAI discloses 19 AI misalignment incidents, from leaked GitHub tokens to hacked chip-design machines — 141_1337 · 2026-10-16
- Paul califax argues extrapolation isn't special: LLMs can learn out-of-distribution skills via high-dimensional interpolation — paul_cal · 2026-10-16