Tsinghua's Puro-2B Replicates Qwen-Level Model for Under $5090 on a Single RTX 5090
Tsinghua's PACMAN lab released Puro-2B, a fully open-source recipe that trains a Qwen2-1.5B-level 2B model from scratch on a single RTX 5090 for under $5090, using Blockwise FP8, the MuonH optimizer, and curriculum model averaging over 1.4T tokens.
2026-08-31 ~ 2026-08-31 · 4 related posts
- Episode 1: Researchers Pretrain 2B Model on a Single RTX 5090 for Under $7,000(2026-08-28, 2 posts)
- Episode 2: Tsinghua's Puro-2B Replicates Qwen-Level Model for Under $5090 on a Single RTX 5090(2026-08-31, 4 posts)
- Train a 2B model from scratch on RTX 5090 for just $4,400 — burny_tech · 2026-08-31
- Puro-2B: Replicate Qwen2-1.5B on RTX 5090 for Under $5090 — burny_tech · 2026-08-31
- Train a Qwen2-Level Model on RTX 5090 for Under $5090 — zhaoran_wang · 2026-08-31
- Puro-2B: pretraining a 2B model on RTX 5090 for under $5090 — thu-pacman · 2026-08-31