SemiAnalysis: SGLang on AMD Mi355 crushes B200/B300 in throughput test
AnushElangovan · x · 2026-11-07
SemiAnalysis posted benchmark results showing SGLang "framemogging" — dramatically outperforming — on AMD Instinct Mi355 compared to running on NVIDIA B200/B300. Coming from the third-party semiconductor analysis firm, it suggests AMD's newest AI GPU is competitive with NVIDIA's top-end cards on LLM inference workloads.
More from Infra
- Redditor runs Qwen Flash Next locally at 24 tok/s on 64GB MacBook via Strata SSD offloading — New-Pressure-6932 · 2026-11-07
- Reactor co-founder publishes 'The real-time manifesto' on serving real-time AI at scale — smtabatabaie · 2026-11-07
- Clairvoyance's new hivemind feature lets you share your GPU with anyone — draginol · 2026-11-07
- zml/llmd inference server runs on NVIDIA, AMD, Intel, TPU and Metal with images as small as 142MB — siwu · 2026-11-07
- Sequoia's Maguire models SpaceX taking inference compute share as neoclouds struggle — shaunmmaguire · 2026-11-07
- Musk teases 'Starmind computer' details next year, promising it will 'blow people's minds' — ns123abc · 2026-11-07