20 minutes on one H200: GRPO post-training makes Qwen 3.5-2B more accurate and token-efficient
johnolafenwa · reddit · 2026-09-04
Open-source models tend to over-reason on every problem. The author released a notebook and video implementing GRPO from scratch and using it to post-train Qwen 3.5-2B for better accuracy and reasoning efficiency.
The interesting result: trained purely on simulating a Python interpreter, the model became substantially more accurate and token-efficient on math problems — a clear generalization effect. Training took 20 minutes on a single H200, and the code applies to any open-source model.
- Code: agi-playground/grpo
- Full walkthrough and results: YouTube video
- Before/after result charts included
More from Research
- Matrices are graphs and graphs are matrices: linear algebra's most undervalued fact — TivadarDanka · 2026-09-04
- Simulation physics gaps teach robots tricks that fail in the real world — binarybits · 2026-09-04
- How robot startups scrape for data: free cleanings, exoskeletons, sim limits — binarybits · 2026-09-04
- Google Research uses transfer learning to improve genomic prediction for underrepresented populations — Google Research · 2026-09-04
- AI benchmarks may understate AI by 82%: routing across 44 LLMs cuts errors 46% — CodeByPoonam · 2026-09-04
- davidad conjectures multi-AI reward coupling and self-DPO share one basin-forming mechanism — davidad · 2026-09-04