OpenAI unveils first in-house inference chip Jalapeño with benchmark claims beating Nvidia

OpenAI published the first benchmark results for its in-house inference chip Jalapeño, claiming wins over Nvidia's GB200 and GB300 flagship systems; SemiAnalysis's teardown similarly views it as a general-purpose LLM inference ASIC. Co-developed with Broadcom in roughly 16 months from team formation to tape-out, it is slated for deployment by year-end as the first step of a multi-generation roadmap. Current caveat: the striking numbers come from OpenAI's own InferenceX benchmark and SemiAnalysis analysis, with no independent third-party or Nvidia verification yet.

Confirmed

• OpenAI officially announced Jalapeño with first test results; the chip was co-developed with Broadcom in about 16 months (@OpenAI, @dylan522p, @zephyrz9, @borowcy).
• On OpenAI's InferenceX public benchmark using GPT-OSS 120B, DeepSeek R1 670B and Kimi K2: 1.5–1.9x higher work per watt, 1.7–3.6x lower end-to-end latency, higher peak throughput per kW, lower token latency, and better TCO than compared commercial systems (@OpenAI, @kimmonismus, @Polymarket).
• At matched DeepSeek R1 decode speed, throughput per kW is 104.3x that of Nvidia GB300 (12,258 vs 118 tok/s/kW) (@rohanpaulai).
• SemiAnalysis's teardown says Jalapeño is a from-scratch general-purpose LLM inference ASIC, not narrowly tuned to OpenAI models, with measured efficiency exceeding Nvidia and AMD Blackwell-class parts; per-watt performance up to 2x above Nvidia's Rubin announced in July, even without speculative decoding (@zephyrz9, @dylan522p, @gddr5, @nickbaumann).
• OpenAI says the chip will speed up ChatGPT responses, Codex sessions and agent responsiveness, and ensure reliable access as demand grows (@OpenAI).
• Deployment is planned before year-end; a second generation is in deep development and a third is taking shape (@OpenAI).
• Reports relayed by @thesaraharminta put power at 700W, designed for large-model inference to cut data-center costs.
• Cathie Wood, citing ARK analysis, says Broadcom is helping OpenAI build the chip, with Jalapeño at the throughput-per-kW frontier across decode speeds on GPT-OSS-120B (@CathieDWood).

Unconfirmed

• All performance figures lack independent verification; test conditions behind the '104.3x' figure (system configs, quantization, batching) await further disclosure.
• @WonderfulBuffalo32 says OpenAI claims wins over the newer Vera Rubin platform, while @thesaraharminta's relayed report says internal tests did not compare against Vera Rubin — a discrepancy pending clarification.
• Speculation relayed by @cloneofsimo that the chip merges GPU/TPU strengths, won't be sold externally, and that China will clone it within three years is unverified opinion.

Why it matters

• This is OpenAI's first public silicon benchmark, marking its strategy to reduce Nvidia dependence entering execution; if the general-purpose ASIC positioning holds, it poses real competitive pressure on Nvidia and AMD in data-center inference.
• The disclosed second- and third-generation roadmap signals a long-term silicon product line rather than a one-off experiment, potentially reshaping the cloud inference chip landscape.

2026-08-25 ~ 2026-08-27 · 67 related posts

Full story(7 episodes)→

• Episode 1: OpenAI unveils first in-house inference chip Jalapeño with benchmark claims beating Nvidia(2026-08-25, 67 posts)
• Episode 2: OpenAI Unveils Jalapeño, Its First Custom Inference ASIC, at Hot Chips(2026-08-26, 7 posts)
• Episode 3: OpenAI Reveals First Real Data of Its Inference Chip Jalapeño, Sparking Debate Over Nvidia's Weakness(2026-08-26, 6 posts)
• Episode 4: OpenAI Used AI Models to Help Design Its First Chip(2026-08-27, 2 posts)
• Episode 5: Report: OpenAI's in-house Jalapeño chip may outperform Nvidia Blackwell(2026-08-27, 2 posts)
• Episode 6: OpenAI's Custom Inference Chip Jalapeño Tapes Out, Claiming Efficiency Gains Over Nvidia(2026-08-30, 14 posts)
• Episode 7: OpenAI Unveils First In-House Inference Chip Jalapeño with Broadcom(2026-09-04, 2 posts)

• [source] SemiAnalysis: OpenAI's Jalapeño Is a General-Purpose Inference ASIC Beating NVIDIA and AMD in Tests — zephyr_z9 · 2026-08-25
• OpenAI Reveals Jalapeño Benchmarks: Beats Blackwell in Efficiency — dinabass · 2026-08-25
• Media Reports on OpenAI Jalapeño Benchmark Data — shiringhaffary · 2026-08-25
• OpenAI's 'Jalapeño' Chip Beats Nvidia Blackwell in Benchmarks — dylan522p · 2026-08-25
• OpenAI claims custom 'Jalapeño' chip outperforms Nvidia GB200/GB300 in inference — Polymarket · 2026-08-25
• [source] OpenAI's Jalapeño chip claims 104.3x better efficiency than Nvidia GB300 — rohanpaul_ai · 2026-08-25
• OpenAI's first custom inference chip Jalapeño claims 1.5-1.9x better perf-per-watt than Nvidia GB200/GB300 — kimmonismus · 2026-08-25
• Jalapeño ASIC outperforms comparable TPUs, challenging existing giants — GavinSBaker · 2026-08-25
• OpenAI Claims New 'Jalapeño' Chip Outperforms Vera Rubin in Benchmarks — Wonderful_Buffalo_32 · 2026-08-25
• Jalapeño ASIC benchmarks before TPU support, showing competitive performance — GavinSBaker · 2026-08-25
• Jalapeño Claims Industry-Leading AI Inference Speed and Efficiency in First Results — pstAsiatech · 2026-08-25
• OpenAI's in-house inference chip reportedly rivals GB300, NVIDIA impact seen as limited — ivan_bezdomny · 2026-08-25
• Deep Technical Overview of OpenAI's Upcoming Inference Chip: Jalapeno — Much_Preparation_832 · 2026-08-25
• Discussion: OpenAI's In-House Chip 'Jalapeño' May Outperform Nvidia Blackwell — thehiphopswami · 2026-08-25
• OpenAI: Jalapeño Chip Speeds Up ChatGPT Responses and Codex — OpenAI · 2026-08-26
• OpenAI to Deploy Jalapeño by Year-End, Gen 2 and 3 in Development — OpenAI · 2026-08-26
• Jalapeno beats VR200 with optimized DeepSeek implementation, faster execution — itsclivetime · 2026-08-26
• OpenAI Used Unreleased Model Astra to Design Its Jalapeño Inference Chip in 9 Months — jarrodwatts · 2026-08-26
• OpenAI Jalapeño Better Than Nvidia Blackwell: SemiAnalysis — gddr5 · 2026-08-26
• OpenAI's Gen 1 Chip Challenges Nvidia Vera Rubin in Inference Efficiency — haider1 · 2026-08-26
• OpenAI Jalapeño Outperforms Nvidia Rubin with Massive Software Gains in 5 Days — teortaxesTex · 2026-08-26
• Deep Dive: OpenAI's Custom Chip Jalapeño May Outperform Cerebras — bookwormengr · 2026-08-26
• OpenAI's Jalapeño Chip Leak: Potential 50x Speed Boost for GPT — Yuchenj_UW · 2026-08-26
• Report: OpenAI's 'Jalapeño' ASIC Could Outperform Nvidia Blackwell in TCO and Efficiency — ivan_bezdomny · 2026-08-26
• OpenAI's Jalapeño Chip Reportedly Beats Nvidia Blackwell on Perf/Watt — petrusenko_max · 2026-08-26
• Sam Altman Hints at OpenAI's Custom Chip: 'It is Fast' — LinusEkenstam · 2026-08-26
• Jalapeño Cuts DeepSeek R1 Latency by 4.9x — AccBalanced · 2026-08-26
• Rumor: OpenAI's Custom Chip Jalapeño Shows Big Gains, Deployment by Year-End — soumitrashukla9 · 2026-08-26
• SemiAnalysis: Jalapeño Chip Outperforms VR200 TPU — bookwormengr · 2026-08-26

21 near-duplicate retellings: firstadopter · GavinSBaker · thesaraharminta · firstadopter · OpenAI · itsclivetime · testingcatalog · testingcatalog · rohanpaul_ai · OpenAI · OpenAI · OpenAI · mark_k · borowcy · brianryhuang · iScienceLuvr · Sethwinterroth · ivan_bezdomny · Dr_Singularity · Moh1tAgarwal · AI寒武纪