AMD MI355X beats NVIDIA B300 on tokens-per-dollar in AgentX
AccBalanced · x · 2026-09-07
SemiAnalysis reports that an AMD MI355X submission with vLLM and LMCache beats the NVIDIA B300 on total tokens per dollar TCO at lower interactivity ranges on AgentX.
A viral quote-post jokes that markets need six months to reprice the "NVIDIA is safe" slide now that cheaper tokens are on the table.
More from Infra
- Meta researcher: horrifying infra, not talent, is why OSS can't catch closed frontier — A_K_Nain · 2026-10-23
- Jane Street and NVIDIA speed up Mamba-2 with custom cuTile kernels — blelbach · 2026-10-23
- LatentLoop: asymmetric compute allocation cuts looped-MoE training cost by 19% — pmttyji · 2026-10-23
- Same AI request emits 8.5x more CO2 in Texas than in Sweden — jlundberg · 2026-10-23
- SK Hynix Pulls Plug on Solidigm US IPO as Chip Stocks Slide, Shares Down ~30% This Quarter — rohanpaul_ai · 2026-10-23
- Designer mocks Nvidia: buy idle GPUs or lose access to new ones—definitely not a bubble — michalmalewicz · 2026-10-23