Inference Revenue is Skyrocketing
BlackHC · x · 2026-07-16
This response highlights an argument: inference revenue is growing roughly 3x annually, while models themselves are becoming smaller and cheaper.
The author argues that although the original text cited this source, it reached the opposite conclusion in its reasoning, which is logically flawed.
Related event: BlackHC Rebuts the “AI Is the Worst Technology” Thesis(5 posts)→
More from Infra
- 12 KV Cache Reduction Techniques Every AI Engineer Should Understand, Explained — blaizedsouza · 2026-09-11
- The shadow GPU capacity market is formalizing, with Meta selling excess compute to outside buyers — DavidLinthicum · 2026-09-11
- Engram's random reads don't suit SSDs; CPU-memory over NVLink could serve all 72 GPUs — bookwormengr · 2026-09-11
- 80% of the DIY LLM inference hype posters have already quit — it's brutally hard systems work — abhijithneil · 2026-09-11
- Hugging Face's Ultra Scale Playbook: a free book on training LLMs on GPU clusters — mdancho84 · 2026-09-11
- Is inference latency becoming the biggest bottleneck for production AI agents? — Euphoric_Sea632 · 2026-09-11