Qwen Learns to Train Qwen
DanAiTuning · reddit · 2026-07-14
The author states they trained Qwen3.6-35B-A3B into a model that "uses RL to train other models": upon receiving a task, it writes the entire training job—including environment, rewards, datasets, and hyperparameters—and submits it to real GPUs for execution.
Training Method
- Inner loop: Trains small Qwen models (0.6B / 1.7B) on real GPUs using prime-rl and verifiers
- Outer loop: Uses Tinker to perform RL on the trainer itself, with "the trained small model becoming stronger" as the reward
- A total of 6 task categories were designed, with 1 category entirely reserved for generalization testing
Results
- Outer episode reward increased from 0.0 to a peak of 0.63, backed by roughly 1750 real training jobs
- Transfer occurred on unseen task families, indicating it isn't just rote memorization
- The trainer learned to use the 1.7B base more often and began truly utilizing the hyperparameter space
- Total cost was approximately $1.3k, with a single inner-loop training costing about $0.13–0.30
The author open-sourced the repository, task families, reward code, GPU scheduling, and a retrospective.
Related event: Developer Uses RL to Train Qwen to Train Other AI Models(2 posts)→
More from Research
- Nature paper images cellular activity across all organs, revealing body-wide circuits — arjunrajlab · 2026-09-11
- SignNet 1M Dataset Released for Sign Language Research — ducha_aiki · 2026-09-11
- ECCV26 Oral: Flow Matching Enables Single-Stage Multi-View Point Cloud Registration — ducha_aiki · 2026-09-11
- InFlux++ Method Released — ducha_aiki · 2026-09-11
- Skyfall GS Uses Flux to Refine Gaussian Splatting, Accepted at ECCV 2026 — ducha_aiki · 2026-09-11
- Could 10k agents discover learning methods beyond backprop, or just tweak existing ones? — SeunghyunSEO7 · 2026-09-11