CrowdGPT trains a 1B collaborative LLM with zero dollars: 85 contributors, 13B tokens in a week
Vxtzq1 · reddit · 2026-11-08
CrowdGPT, an open-source non-profit project on r/LocalLLaMA, is building Crowd-v1 — a 1B-parameter transformer trained collaboratively with no datacenters and zero dollars, aiming to match Qwen3-0.6B on benchmarks as a proof of concept, then scale to 7B/30B MoE.
- Since the previous post, 85 contributors registered and trained 13B tokens in one week.
- The pipeline is community-driven end to end: data submission, preparation, training, and benchmarking; all source is auditable on GitHub, and anyone can submit data at crowdgpt.net.
- The stated motivation: stop waiting on Chinese/American AI labs for open-weight models and train them ourselves on idle GPUs.
The project is early-stage WIP, with contributions on training mechanics and datasets welcome.
More from Models
- Open coding models turned telegraphic: filler words down 25–50% across 12 models — thesephist · 2026-11-08
- Claude Opus 5.5 casually suggests deleting your entire ~/.codex/sessions directory — keunwoochoi · 2026-11-08
- Polymarket odds: only 39% chance Claude 6 ships by March 2027 — Polymarket · 2026-11-08
- Law professor asks Claude to update page numbers, returns to find a year of files deleted — Polymarket · 2026-11-08
- Security researcher: GPT-6 cyber devises exploit techniques never seen publicly before — steipete · 2026-11-08
- METR finds Anthropic model progress accelerating 1.9x since Oct 2025; Hanson calls it one-time speedup — sebkrier · 2026-11-08