Crowdsourced inference network idea: run open models for others on consumer GPUs
airesearch12 · x · 2026-09-18
airesearch12 proposes a crowd inference provider where people run open models for others on consumer hardware, framing routing as a game-theory optimization guided by probabilities and real stats. Combined with local inference and a P2P community, it could get interesting; repliers note routing would move to outer loops where starting from an empty cache is reasonable.
More from Infra
- Payments firms race to own AI inference: Stripe taps OpenRouter, Ramp enters the chain — xkonjin · 2026-09-18
- Qdrant wraps 4+ hour Vector Space Stream on vector search — recording now live — qdrant_engine · 2026-09-18
- Investor: QNX's microkernel is an undervalued moat for the agentic AI era — pdamodaran · 2026-09-18
- Inception CEO Stefano Ermon argues diffusion will beat autoregressive models on inference efficiency — No Priors · 2026-09-18
- Inception CEO Stefano Ermon: Diffusion Beats Autoregressive LLMs on Inference — No Priors · 2026-09-18
- Zalando details its Kubernetes-based internal agent platform with kagent and kro — bibryam · 2026-09-18