shardr: a content-addressed model store with BitTorrent sync and OpenAI-compatible serving
Cyb3erDudu · reddit · 2026-10-02
- Open-source Go daemon shardr (Apache-2.0) tackles local model pain points: duplicate 40GB quants, models vanishing from Hugging Face, and per-tool weight copies
- Key design: SHA-256 content-addressed storage, BitTorrent v2 pull/seeding, a llama-server runner with OpenAI-compatible API that mmaps weights (single disk copy), and a lockfile pinning upstream llama.cpp release binaries
- Works with the pirateface.co catalog; pulls are anchored to HF checksums, and rescued models of delisted repos require explicit --trust-catalog opt-in
- macOS arm64 and Linux amd64 only for now; author seeks feedback on imports and the trust model
More from coding & agent
- A fun use of Cursor Projects: recreating videos straight from the timeline — mattyp · 2026-10-02
- No one on the team knew Blender — Claude ran the whole 3D film workflow — gen_ericai · 2026-10-02
- CoreWeave launches Agent Lens, its take on agent observability — _ScottCondron · 2026-10-02
- Full pipeline for an AI music video: Midjourney, Suno, three.js and ffmpeg — ciguleva · 2026-10-02
- XState FSM returns in alpha at ~0.4 kB gzipped, strongly typed and visualizable — DavidKPiano · 2026-10-02
- AAIF London to host agentic AI meetup on agents in finance at Gradient Labs on Oct 15 — neal_lathia · 2026-10-02