mitsuhiko: Renting 1,000 GPUs won't cut it unless you build your own data center
mitsuhiko · x · 2026-09-19
In an exchange on X, thdxr notes that renting 1,000 GPUs is already hard, and they'll likely sit in a generic setup where hardware can never be matched across batches. mitsuhiko replies that he looked into it briefly and it didn't look promising unless you also build the data center and procure everything yourself.
More from Infra
- The rig built to run Emacs and doomscroll X is now worth more than its owner's car — tetsuoai · 2026-09-19
- Apple M4 sustains 10 instructions per cycle, beating most rivals; M5 speedup explained — lemire · 2026-09-19
- Apple M6 bumps cores to 12 with two super cores; CPUs keep improving fast — lemire · 2026-09-19
- Apple M-series chips gained ~50% Geekbench 6 performance over three years — lemire · 2026-09-19
- Inside OpenAI's inference routing: why the proportional controller had to go — AI Engineer · 2026-09-19
- "Normal people can't afford 2x DGX Spark": local AI hardware cost debate — FlolightC · 2026-09-19