huggingface_hub v1.32 dedupes Xet files in local cache: 5 repos sharing 20GB weights now use ~20GB
victormustar · x · 2026-09-18
huggingfacehub v1.32 brings content-addressed deduplication to the local cache: identical Xet-backed files across repos are stored only once. Example: 5 repos sharing the same 20 GB weights file now take 20 GB on disk instead of 100 GB.
- Xet already made remote storage content-addressed; that identity now extends into the local cache
- Once a blob is local, other repos can reuse it with zero payload download
- A real disk saver for anyone pulling many fine-tuned or quantized variants built on shared base weights
Related event: huggingface_hub v1.32 Adds Shared Download Cache Across Repositories(2 posts)→
More from Infra
- Fire at Taiwan Panasonic PCB materials plant may tighten CCL supply further — zephyr_z9 · 2026-11-04
- Same Claude model served by Bedrock one day and Anthropic the next, dev finds — georgos_pappas · 2026-11-04
- Self-improving software is inevitable: closing the agent-observability loop — bibryam · 2026-11-04
- Gigabyte's AI TOP motherboard packs 2TB RAM and 9 GPUs for home AI labs — vincent_koc · 2026-11-04
- Building a 7-GPU 132GB VRAM local inference rig: consolidate on EPYC or split across two systems? — infectiousstupidity · 2026-11-04
- imec neural probe integrates photonics directly into 130nm CMOS backend — jwt0625 · 2026-11-04