Former AWS operator says Bedrock margins can beat SageMaker as agentic AI lifts CPU demand
RihardJarc · x · 2026-07-21
A former senior AWS employee argues that Bedrock sits higher up the stack than SageMaker, so it can carry better margins—roughly a 15% uplift from going one layer up.
- In his example, AWS may take a cut for bringing customers to Anthropic, Anthropic may take around 40%, and AWS then earns again by running and operating the model.
- He says hyperscalers like AWS, GCP, and Azure sell a full AI stack: governance, guardrails, data, CPU compute, databases, storage, and more—not just model access.
- His rough forecast is that agentic AI will push CPU demand to about 2x–3x of GPU demand over the next few years.
- His bottom line: hyperscalers win either way. If closed models win, they still sell GPUs and compute; if open-weight models win, they may even keep more margin because they can customize models without paying model fees.
More from Infra
- NVIDIA details Vera CPU with 2x performance claims and a 22,000-core rack — ryanshrout · 2026-07-22
- NVIDIA says Vera Rubin NVL72 delivers 10x more tokens per megawatt than Blackwell — nvidia · 2026-07-22
- AI economy is running out of cheap compute as data-center and power costs surge — Scobleizer · 2026-07-22
- Ratel says it made agents 7x cheaper by loading only the tools each task needs — tensorqt · 2026-07-22
- Weaviate adds per-query profiling to pinpoint where a slow search query spends time — CShorten30 · 2026-07-22
- Mistral expands its Microsoft partnership as it adds more AI compute in Europe — MistralAI · 2026-07-22