DumpsterCluster: Serving LLaMA-70B on $60 GPUs
Oxford · hf · 2026-08-18
The DumpsterCluster project by Oxford demonstrates using retired GPUs to form low-cost clusters for running LLMs like LLaMA-70B. The study indicates that the economic viability and environmental benefits of this approach depend heavily on local electricity prices and carbon intensity. It explores new avenues for acquiring low-cost compute.
More from Infra
- Google Open Sources SAM: Infrastructure for Agent P2P Networks — rakyll · 2026-08-18
- Running MiniMax H3 on Colab T4 by Splitting Pipeline Stages — james_hito · 2026-08-18
- KDD Cup Winners Unify Recommendation Systems, Team Built Winning Code with DeepSeek — 量子位 · 2026-08-18
- Reddit proposes pooling consumer GPUs into time-shared mesh to run 1T+ models — aliljet · 2026-08-18
- Ant Group open-sources AReno: single-node toolkit for LLM RL post-training and serving — pmttyji · 2026-08-18
- Stop Indexing at Full Precision: Compressed Vectors Cut Storage by 60x — _reachsumit · 2026-08-18