Standard Kernel uses AI-written kernels to make abandoned Intel Gaudi2 beat H100 by 1.6x on decode
anneouyang · x · 2026-11-19
Standard Kernel shows AI-generated software can make Intel's abandoned Gaudi2 outperform the NVIDIA H100: 5,409 tokens/s cached-prefill throughput (1.08x H100), 475 tokens/s decode (1.6x H100), and decode costs of $0.35 per 1M tokens — 9.4x cheaper than H100's $3.28. The takeaway: software, not hardware alone, determines accelerator performance and economics.
More from Infra
- Open-source prefill engine hits 3.2× vLLM throughput serving GLM-5.3-Flash on 4 B200s — bariskasikci · 2026-11-19
- Bill Ackman slams Nvidia board for 'major governance failures' over Jensen Huang succession — Polymarket · 2026-11-19
- 5060 Ti 16GB vs 5070 12GB: Reddit debates VRAM vs speed for local AI use — BuckinBronco999 · 2026-11-19
- rakyll is bringing agentic compute and platforms to Kubernetes, asks what to build — rakyll · 2026-11-19
- Arm CEO: NVIDIA Partnership Unchanged; AI Boom Resembles 1880s Railroad Buildout — BenBajarin · 2026-11-19
- YC-backed Tilion launches browser infra for agents, claiming #1 in stealth and speed — joshalbrecht · 2026-11-19