Dev open-sources self-hosted model registry so inference workers boot when HF is down

cmm324 · reddit · 2026-11-19

The author built Model Delivery for Otium, a batch inference system that spins up workers on AWS Spot instances. A self-hosted registry mirrors pinned Hugging Face revisions ahead of time, preserving revision IDs and verifying file hashes, so workers can boot even if the Hub is down, a repo is removed, or upstream access is cut during a security incident.

Original post →

More from Infra

Infra channel →