OpenAI's Jalapeño inference chip: 9 months to tapeout, one chip beats GPU+LPU pair

thehiphopswami · x · 2026-08-28

A new SemiAnalysis podcast episode takes a deep dive into OpenAI's Jalapeño inference chip announced at Hot Chips:

• "Dark silicon is cheaper than idle accelerators": one balanced chip may beat a GPU + LPU pair
• Nine months from RTL to tapeout, a Blackwell-class chip designed with AI for EDA
• NUMA-style local HBM slices per accelerator fix the "operands arrive late" problem
• Broadcom ESUN scale-up: 128 chips per rack at 600 GB/s, 2,048 chips across 16 racks still count as scale-up
• The "regret factor": the opportunity cost of missing a future model beats the cost of generality

Plus spicy extras like whether OpenAI should sell the chip externally.

Related event: OpenAI Reveals First Real Data of Its Inference Chip Jalapeño, Sparking Debate Over Nvidia's Weakness(6 posts)→

Original post →

More from Infra

• Jensen Huang joins BG2 podcast: does AI revenue justify capex, '27 bottlenecks — elonmusk · 2026-10-16
• Mistral's on-device infra rack revealed: DGX Spark, Mac Studio and more — gregmushen · 2026-10-16
• NVIDIA and Sweden's Wallenberg launch Sferical One, a shared AI supercomputer — nvidia · 2026-10-16
• Next infra frontier: self-evolving systems that adapt and self-verify — _shreya_s · 2026-10-16
• Xiaomi's MiMo RL dashboard reveals $3.47M spent on just 30 training steps — bycloud · 2026-10-16
• Cerebras pushes disaggregated inference: heterogeneous prefill pools feeding wafer-scale decode — ai · 2026-10-16

Infra channel →