Neoclouds now gross ~$38 per GPU-hour at 155 trillion tokens/day per cluster
basedjensen · x · 2026-10-21
Cited figures: a single inference cluster is serving 155 trillion tokens/day at an overall revenue of about $38 per card per hour (off-peak pricing). basedjensen's takeaway: neoclouds have just become remarkably profitable — a key data point for unit economics of inference compute.
More from Infra
- Ex-Google insider: compute bottlenecks go beyond power; open models replacing frontier APIs — xiaosun86 · 2026-10-21
- ByteDance, Alibaba, Tencent order 3M+ Nvidia RTX PRO 5500 cards worth $35B, Reuters reports — SumitGup · 2026-10-21
- TorchTPU demo: unified vLLM & SGLang backend for LLM serving on TPUs — Rob_Mulla · 2026-10-21
- Google, Red Hat release llm-d 1.0: open K8s-native distributed inference stack — rseroter · 2026-10-21
- acs infra launches free base model API offering Llama 3.1 8B and 405B for LLM psychology researchers — amplifiedamp · 2026-10-21
- Developer Moves AI Agents to a Dedicated Linux Workstation Using Incus System Containers — kevinkern · 2026-10-21