Puro-2B: an open recipe trains a Qwen2-1.5B-beating LLM on RTX 5090s for just $4.4K
IgorCarron · x · 2026-09-25
Puro-2B announces a fully open pretraining recipe for a 2B LLM that can be trained from scratch on consumer RTX 5090 GPUs:
- $4.4K: a model that beats Qwen2-1.5B
- $6.9K: approaches Qwen2.5-1.5B level
- Data, pipeline, and hyperparameters are all public and reproducible
Igor Carron ties it back to his 2021 essay "The $1,000 GPT-3": just as genome sequencing costs collapsed far faster than Moore's law once competition intensified, small-model pretraining costs are now undergoing a similar commoditization — progress doesn't come from one technology's steady march, but from a diversity of challengers.
More from Infra
- UK Sovereign AI invests in Fractile to build next-gen frontier AI chips — charlieharris01 · 2026-11-11
- What happened when I moved vector retrieval into Snowflake SQL instead of orchestrating RAG outside — dima806_dima · 2026-11-11
- AI chip startup Fractile raises $720M Series C for DRAM-on-processor design — Tom_Westgarth15 · 2026-11-11
- Mobile AI Factory: agentic pipeline builds on-device SLMs that beat 5-shot frontier models — kalyan_kpl · 2026-11-11
- Vivo's Starlink direct-to-cell service hits 10M users in two weeks across Brazil — XFreeze · 2026-11-11
- Nan Ya Plastics to spend NT$11.53B on fifth glass fabric plant on AI server demand — zephyr_z9 · 2026-11-11