dill-lab Open-Sources 108 Small Language Models with ~3,900 Checkpoints

dill-lab has released 108 OLMo-style language models (4M–75M parameters) along with roughly 3,900 intermediate checkpoints on HuggingFace, accompanying their ICML 2026 paper.

2026-10-15 ~ 2026-10-15 · 2 related posts

• 108 OLMo-style LMs (4M-75M) with ~3.9K checkpoints from ICML paper released on Hugging Face — BrihiJ · 2026-10-15
• 108 OLMo-style LMs (4M–75M) with ~3.9K checkpoints released from ICML paper — BrihiJ · 2026-10-15