Curie: a from-scratch 17B model designed to run from SSD, 33 tokens/s on one CPU core
Just_Vugg_PolyMCP · reddit · 2026-09-12
A developer released colibrì, an engine treating SSD, RAM and GPU as a single memory hierarchy, plus Curie, a 17B model designed for it, asking why a model whose weights fit a $60 SSD should need a $30,000 machine.
Key facts
- colibrì can run models that don't fit in RAM or VRAM, including hundreds-of-billions-parameter models, on ordinary hardware.
- Most open models assume VRAM, so the author designed Curie from scratch: written in C, no inference framework, trained on a laptop without a GPU, weights living on SSD loaded by execution path.
- Demo reaches 33 tokens/s on a single CPU core, vs 3-5 tokens/s for dense 12B models on the same machine.
- Major caveat: Curie has seen only 11 million training tokens and isn't useful yet; billions of tokens are needed before proper evaluation. The alpha demonstrates the architecture; the model isn't public.
More from Infra
- DeepInfra launches DeepCluster dedicated B300 clusters from $2.99/GPU-hour — niloofar_mire · 2026-09-12
- OpenAI's storage platform Habitat grew 10x YoY; Python service peaked at 20M requests/sec — xeophon · 2026-09-12
- Tencent's Open-Source CubeSandbox v0.7 Ships 60ms-Cold-Start MicroVMs for Agents — dr_cintas · 2026-09-12
- Dynamic llama.cpp Config Manager Pushes 27B Model From 167k to 262k Context on One 32GB GPU — wadeAlexC · 2026-09-12
- DigitalOcean Launches M.A.R.S. Managed Agent Runtime With First-Party OpenAI Agents API Support — OpenAIDevs · 2026-09-12
- Instinct may burn $100M+ a year in tokens, and open-weight models aren't actually cheaper — ivan_bezdomny · 2026-09-12