smolcluster: Distributed training library using only Python Sockets
retr0jirachi · x · 2026-08-19
smolcluster is an educational distributed deep learning library designed to run on heterogeneous hardware like Mac minis, Raspberry Pis, and Windows machines using only Python's socket library. It supports various algorithms including FSDP, ClassicDP, EDP, and Expert Parallelism, prioritizing code readability for learning purposes.
More from Infra
- Polymarket: 70% chance a state enacts data center moratorium by 2026 — Polymarket · 2026-08-20
- Virginia County Expects $1.3B in Data Center Tax Revenue — Polymarket · 2026-08-20
- DeepSeek price hike sparks local setup: hybrid routing cost tactics — LunarLurker-42 · 2026-08-20
- Zero-Markup API Gateway Secures $13.3M in 48 Hours, Exposing Hidden AI Costs — Scobleizer · 2026-08-20
- OpenWolf: Optimize AI Coding Assistant Context with 7 Invisible Hooks — tom_doerr · 2026-08-19
- Gatana adds encrypted persistent storage to MCP Gateway — Gatana_Official · 2026-08-19