GPU rental rates split by chip generation: B300 +8.6% in a week, A100 only +2%
AccBalanced · x · 2026-10-26
SiliconData's Reference Price newsletter flags a "generational slope" in on-demand GPU rental rates: over the past week, increases ranked by chip generation — B300 +8.6%, B200 +4.7%, H200 +4.2%, H100 +2.5%, A100 +2.0%. All indices hit ATHs, and even the recently soft A100 index is inflecting.
The compute shortage appears concentrated in the newest chips: long-context inference is increasingly memory-bound, favoring chips with the most HBM. The open question is whether rents are starting to separate by capability rather than rising uniformly. Meanwhile the LLM Token Index fell 3.1% on the week and is down 24.1% YTD, a notable divergence from GPU rental costs.
More from Infra
- gpu-unlock boosts RTX 3090 Ti BF16 GEMM 87.5→157.4 TFLOPS — jiqizhixin · 2026-10-26
- Anthropic engineer: Claude Code cache hit rates are now high, savings live — teortaxesTex · 2026-10-26
- Six-month bet: hybrid AI deployments, not a wholesale shift to local models — yi111 · 2026-10-26
- Deco decouples 'thinking' from 'spelling' in generative recommenders for 3.2-8.6x throughput — _reachsumit · 2026-10-26
- Redditor with $4,000-$5,000 budget seeks local AI video generation hardware advice — dewsphere · 2026-10-26
- ThousandML Open-Sources CQ 4-bit QLoRA: 17.4% Lower Val Loss Than Unsloth NF4 — textclf · 2026-10-26