First third-party TPU inference benchmark: Google Ironwood up to 50% better perf/$ than B200
dylan522p · x · 2026-09-08
SemiAnalysis and the InferenceX team published the first open third-party inference benchmarking of Google TPUs, running daily across many models and scenarios. Key takeaways:
- Headline result: In apples-to-apples tests, TPUv7 Ironwood delivers up to 50% better performance per dollar than B200/B300, holding an advantage across much of the Pareto curve.
- Economics: The report analyzes both Google's internal TCO and the external TCO a real customer pays.
- Context: Anthropic is the biggest TPU user, committed to over 1 million chips (400k+ direct purchases, 600k+ rented via GCP), and will surpass DeepMind's usage by 2029.
- Trend: Rapid externalization of the TPU stack (Ironwood, TPUv8i) is eroding NVIDIA's CUDA moat.
More from Venture
- Revolut founder Storonsky: investor pushed me to fire my best engineer, so I removed all VCs from the board — ctjlewis · 2026-10-27
- Anthropic officially files S-1 registration statement with SEC for proposed IPO — TinfoilTricorn · 2026-10-27
- YC F26's EveryApp wants to open-source every business app; OpenSEO already at 24k stars — ycombinator · 2026-10-27
- Gary Marcus asks why Anthropic couldn't legally disclose Q3 numbers in its S-1 filing — GaryMarcus · 2026-10-27
- Gary Marcus flags Nov 11-15: Anthropic's Q3 S-1 update and earliest IPO window — GaryMarcus · 2026-10-27
- Kimi K3 Is 'Open' Until You Succeed: License Caps Free Use at $20M Revenue — alex_verem · 2026-10-27