OpenAI's first in-house AI chip Jalapeño taped out in 9 months
OpenAI hardware VP Richard Ho detailed the company's first in-house AI inference accelerator, Jalapeño, on The Data Exchange podcast: the chip went from project start to tape-out in roughly 9 months, with an internal team averaging fewer than 100 people and Broadcom handling much of the physical design and production. The effort marks OpenAI's entry into custom silicon, aimed at cutting inference costs and controlling more of the hardware stack.
Confirmed
- The chip, named Jalapeño, is OpenAI's first in-house AI accelerator, designed for inference with both low latency and high throughput in mind.
- Ho explained the motivation: owning more of the hardware stack reduces inference costs and improves performance.
- The design-to-tape-out cycle took only about 9 months, widely seen as an impressive result for a first-generation chip.
- The internal team averaged fewer than 100 people; Broadcom handled much of the physical design and manufacturing bring-up.
- AI was deeply involved in development: the team used AI tools to compress parts of the workflow, including Google-initiated tooling such as XLS.
Why it matters
- Custom silicon is a key step for OpenAI to reduce reliance on external suppliers like Nvidia and compress inference costs.
- The 9-month tape-out with a sub-100-person team demonstrates how AI-assisted chip design can compress traditional development cycles, with implications for the whole industry.
- The Broadcom partnership offers a replicable model for other AI companies considering in-house chips.
2026-09-17 ~ 2026-09-18 · 5 related posts
- Episode 1: OpenAI Uses Its Own LLMs to Design Jalapeño Chip(2026-09-15, 2 posts)
- Episode 2: OpenAI's Jalapeño chip not AI-designed: 100-engineer team plus Broadcom(2026-09-17, 2 posts)
- Episode 3: OpenAI's first in-house AI chip Jalapeño taped out in 9 months(2026-09-17, 5 posts)
- Episode 4: OpenAI Hardware VP Details Jalapeño, Its First In-House AI Chip(2026-09-20, 2 posts)
Primary sources
- OpenAI's VP of Hardware unpacks the engineering behind its first custom chip — bigdata · 2026-09-17
- [source] OpenAI's Jalapeño chip: AI helped design it in 9 months, then tuned kernels to 88.94% of peak — 创业邦 · 2026-09-18
- OpenAI's VP of Hardware on Jalapeño: first custom AI chip taped out in nine months — ymatias · 2026-09-18
2 near-duplicate retellings: bigdata · thehiphopswami