AWS CEO Matt Garman: AI inference hasn't even reached 1% of its eventual size
rohanpaul_ai · x · 2026-11-12
Asked how early the inference market is, AWS CEO Matt Garman said "you're almost doing a disservice to say that it's like 1% of what it's going to be. I don't think it's even 1%. I think there is a massive runway." The comment underscores the cloud industry's long-term bullishness on AI inference demand.
More from Infra
- Microsoft paper details Maia accelerator and software-defined dataflow for trillion-token-scale serving — thoefler · 2026-11-12
- LMSYS megakernel pushes decoding to 1,109 tok/s on 8× GB300, launches cut 1450→97 — ying11231 · 2026-11-12
- Dev builds all-rust AI OS LexiSuite, claims faster Qwen3 27B inference than Ubuntu — W61k3r · 2026-11-12
- OpenRouter's new routing algorithm cuts GLM 5.3 Flash TTFT 40% and price 17% — AccBalanced · 2026-11-12
- Dell and AMD claim 182 world records with 6th-gen EPYC servers — AccBalanced · 2026-11-12
- KubeCon keynote: computing is shifting from human speed to agent speed — HowDevelop · 2026-11-12