OpenAI's Jalapeño: RTL freeze to tapeout in 9 months, serving ChatGPT 10 weeks after first silicon
thehiphopswami · x · 2026-09-04
The Real Story of OpenAI's Jalapeño at Hot Chips
The specs are solid but not the headline: 6 HBM4 stacks, 216GB at 15.4 TB/s, 700W, designed around speculative decoding. OpenAI claims 1.7x tokens per kW over GB300 on DeepSeek R1 (power-normalized) — while handicapping themselves, letting the GPU baseline use speculative decoding while Jalapeño ran plain single-token prediction.
The Process Is the Story
- A tiny team with barely any traditional chip design experience
- A new Rust-like hardware description language built so AI writes correct code out of the box
- An internal AI optimization loop took the design from functionally correct to beyond expert level
- RTL freeze to tapeout in 9 months; first silicon to serving ChatGPT in 10 weeks
- Gen 2 already approaching tapeout
The author argues this chips away at a 40-year moat: AI-driven chip design is itself the new methodology.
Related event: OpenAI Unveils First In-House Inference Chip Jalapeño with Broadcom(2 posts)→
More from Infra
- PostgreSQL 19 slips to November as LLM-assisted code review floods committers with edge cases — sanjaykalra · 2026-10-21
- Decision Models' routing classifier hits AntSeed, cutting inference cost to 24% of always-Opus — airesearch12 · 2026-10-21
- Eon cuts engineer onboarding from 2 days to 2 minutes with an MCP Gateway on Bedrock AgentCore — AWS ML Blog · 2026-10-20
- a16z's Ben Horowitz says AI buildout isn't the 90s bubble — an investor pushes back — henloitsjoyce · 2026-10-20
- Micron and Nvidia drive ~36% of S&P 500's Q3 earnings growth — Beth_Kindig · 2026-10-20
- NVIDIA lands in Europe: Jensen Huang and German chancellor discuss industrial AI at GTC Berlin — nvidia · 2026-10-20