llama.garden is using torrents and web seeds to decentralize LLM distribution
de4dee · reddit · 2026-07-21
A project called llama.garden is trying to make LLM distribution decentralized and faster by using torrents.
- The team added more web seed URLs that route through their API to improve initial seeding speed.
- They built an API that resolves Hugging Face CDN links to actual URLs and caches them, and also improved qBittorrent web-seed support.
- Torrent names now match the real repo name instead of hash-like folder names.
- They open-sourced more scripts for remotely managing seed boxes.
- They also tested a torrent for one of Unsloth’s 10 TB repos and claim the model files exactly match the HF commit, so the distribution can be community-verified and tamper-resistant.
More from Infra
- NVIDIA starts rolling out 102.4 Tbps Spectrum-6 switches for Vera Rubin AI factories — nvidia · 2026-07-21
- Mustafa Suleyman says Microsoft is preparing for an OpenAI exit, while a new chip costs 30% less than GB200 — thoefler · 2026-07-21
- Speculative decoding boosts Qwen3.6-27B on one 5090, but slows crowded servers — luke_pacman · 2026-07-21
- NVIDIA says Blackwell Ultra hit 1,648 TFLOPs per GPU on DeepSeek-V3 671B training — NVIDIAAI · 2026-07-21
- A shopping app demo ties OpenTelemetry, Dynatrace and Port into agentic ops — Pavan_Belagatti · 2026-07-21
- Nvidia Rubin is coming, pointing to the next AI compute platform — ezyang · 2026-07-21