Dev Trains 117M Custom Silia Model on H100

SrijSriv211 · reddit · 2026-07-07

A developer trained a custom 117M-parameter Silia architecture model on an H100 in 5 hours. This project is a practical follow-up to their previously published paper and was made possible by compute sponsored by community members. The model weights have been open-sourced on HuggingFace (Strawberry-s1) and GitHub, alongside a uv-based inference example. However, based on the sample outputs, the small model's generations are largely chaotic and nonsensical.

Related event: Developer Trains and Open-Sources 117M Parameter Silia Model in 5 Hours(2 posts)→

Original post →

More from Research

Research channel →