AutoEnvScaling: agents build their own training tasks for human-free self-play RL

_AndrewZhao · x · 2026-10-14

Recursive self-improvement needs agents that can build their own training environments, but researchers remain in the loop, limiting scale.

The paper introduces AutoEnvScaling, which turns the Data Flywheel into a terminal task: a proposer agent constructs complete Harbor tasks and sandboxes, working much like a human researcher. This enables self-play RL for terminal agents — one model improves as both builder and solver, with no human in the loop.

Related event: AutoEnvScaling Lets Agents Build Their Own Training Environments(3 posts)→

Original post →

More from coding & agent

coding & agent channel →