AMD’s MI300X and MI350 win praise as Anthropic’s reported MI450 deal signals a CUDA challenge
tzmartin · x · 2026-07-23
A Grok-quoted comment says AMD’s MI300X and MI350 series are genuinely competitive for memory-heavy LLM inference and large-batch workloads, thanks to 192GB HBM3, higher bandwidth, and often better price/performance.
It also argues that while CUDA still wins on software ecosystem and real-world throughput for many teams, ROCm has narrowed the gap enough that Anthropic’s reported MI450 deal — up to 2GW from 2027 plus AMD’s $5B investment — shows frontier labs now view AMD as a serious alternative for scaling compute.
Related event: AMD and Anthropic Secure Multi-Billion Dollar AI Partnership(63 posts)→
More from Infra
- LLM Serving Metrics Thread: Why TPOT and Uptime Make or Break User Experience — abhijithneil · 2026-09-11
- PlanetScale launches sharded Postgres: 768 servers acting as one, 1PB scale — dhruv2038 · 2026-09-11
- Can a 7900 XTX 24GB run Qwen locally? Reddit seeks ROCm tok/s benchmarks — thenomadexplorerlife · 2026-09-11
- RTK Terminal Compression Cuts Tokens but Leaves Your AI Coding Bill Unchanged — Bartaseth · 2026-09-11
- SF Compute founder: buying compute is 'an absolutely awful experience' right now — IgorCarron · 2026-09-11
- SmolVM open-sources persistent computer infrastructure for agents that outlive chat sessions — aniketmaurya · 2026-09-11