Researchers Pretrain 2B Model on a Single RTX 5090 for Under $7,000

A new paper introduces Puro-2B, an open-source method that pretrains a 2B-parameter model from scratch on a single consumer RTX 5090 using FP8 precision for under $6,900, achieving performance close to Qwen2.5-1.5B.

2026-08-28 ~ 2026-08-28 · 2 related posts

• Puro-2B Matches Qwen2.5 Performance with $6.9K Pretraining on RTX 5090 — _reachsumit · 2026-08-28
• Puro-2B: Pretraining a 2B model from scratch on RTX 5090 GPUs for under $6.9K — iScienceLuvr · 2026-08-28