GPU shortage debate: companies with real AI demand are still massively compute starved
matt_slotnick · x · 2026-11-20
thdxr argues tech is herdlike: for six months founders repeated 'compute shortage' to signal seriousness, driving companies with zero token demand into crazy GPU commits, with random firms now trying to resell GPUs. mattslotnick counters that listening to founders LARPing AI demand misleads in both directions — companies with actual demand remain massively compute starved and take capacity wherever they can find it.
More from Infra
- Nvidia down ~40% from October peak as Anthropic IPO pops 34% above expectations — The Verge AI · 2026-11-20
- Ion Stoica explains why complex AI workloads increasingly fit Ray's design — PyTorch · 2026-11-20
- GPU rents up, token prices down: inference providers' break-even load jumps 22%–75% in 5 months — AccBalanced · 2026-11-20
- Missing config file was throttling GPUDirect Storage — fix yields 3x reads, 9x writes — AccBalanced · 2026-11-20
- NVIDIA Dynamo cuts RL rollout bottlenecks with KV-aware routing and delta weight updates — NVIDIAAI · 2026-11-20
- Arm reaches the AI laptop: Surface Laptop Ultra runs 120B models locally — kimmonismus · 2026-11-20