Inference providers buy their own chips, scatter across dozens of less secure small clouds
steph_palazzolo · x · 2026-11-12
Per The Information's Steph Palazzolo: inference providers increasingly buy their own chips and run data centers themselves because they can't get allocation from big clouds. That has also pushed them to spread workloads across dozens of smaller clouds that don't always have the best security — a sign of how GPU scarcity is restructuring the inference-layer compute economy.
Related event: Inference providers buy their own chips as cloud quotas run dry(2 posts)→
More from Infra
- Big AI conflates scale with innovation as voters reject data center ballot measures — DavidLinthicum · 2026-11-12
- Musk says SpaceX targets 1TW/year from Earth, rising to 1PW/year from the Moon — ns123abc · 2026-11-12
- Where does Claude's cost really go? Running build tools may quietly add up — IgorBrigadir · 2026-11-12
- Int8 AVX512 VNNI quantization cuts CPU inference to 34ms vs 90ms fp32—2.6x faster — wavefnx · 2026-11-12
- H100 rental rates run 54% above straight-line depreciation, a16z finds — a16z · 2026-11-12
- Apple trains small offline nets to route RAG queries, trading upfront cost for faster retrieval — petrusenko_max · 2026-11-12