Citizen Distributed LLM Training PoC: Port 443 Only, Safetensors, MultiKrum

OrganizationTop9026 · reddit · 2026-11-14

The author connected their HiveMind coordinator with CrowdGPT (led by Vxtzq) for a citizen-trained distributed run around Crowd-v1, an open base model with a 658M transformer trunk (1.01B total params with a 151k-vocab CrowdEngram table), targeting Nov 14–15 CET with a five-minute setup. Addressing why 8–16GB GPU owners usually sit out distributed runs: - communication uses outbound-only HTTPS on port 443, zero inbound listeners- weights move strictly as SHA-256-verified safetensors, no torch.load/pickle- updates pass MultiKrum outlier filtering plus held-out loss checks before merging via DiLoCoThe author candidly notes this is an experimental PoC, not a polished cloud service — don't send private prompts or sensitive keys through volunteer nodes.

Original post →

More from Infra

Infra channel →