Cerebras CEO says inference speed is reshaping the entire AI chip stack
mattturck · x · 2026-07-24
Why the chip industry is reorganizing around inference speed
Matt Turck’s conversation with Cerebras CEO Andrew Feldman traces the AI chip stack from “what is a wafer?” to the idea that inference latency and tokens-per-second are becoming the key bottleneck.
- The discussion compares GPUs, TPUs, Trainium, and ASICs, and explains why fast inference has turned into a separate race alongside training.
- Feldman argues that the hidden constraints are increasingly about memory and packaging — especially HBM, CoWoS, and 3nm supply.
- The interview also covers prefill vs. decode, why GPUs struggle with decode, and how agents are creating more CPU demand.
- On the business side, Cerebras’ model spans hardware, cloud, and API, with a focus on selling “fast tokens” as a cloud product.
- The conversation touches on OpenAI’s 750MW inference deal, the role of megawatt-scale data centers, and why today’s models may end up being “the worst you ever use.”
Related event: Cerebras CEO: Inference Speed is Reshaping the AI Chip Industry(2 posts)→
More from Companies & People
- Fmr. OpenAI Design Head Ian Silber, Who Led ChatGPT and Codex, to Speak at SPC — soleio · 2026-10-26
- Silicon Valley breakdown: five Stanford-area giants worth ~$18T — FinanceYF5 · 2026-10-26
- User suspects X's bundled Grok subscription boosted tweet reach amid algorithm change rumors — talkaboutdesign · 2026-10-26
- "RIP Claude + Chrome": developer flags the end of Anthropic's browser integration — damienghader · 2026-10-26
- a16z podcast: Diode pairs AI PCB design with Brooklyn factory to revive US hardware manufacturing — MattPerault · 2026-10-26
- Vercel Ships 12 New Products at Its 2026 Conference as It Races Rivals for the Agent Entry Point — FinanceYF5 · 2026-10-26