EmbeddedLLM, lead vLLM ROCm maintainers, finally get persistent AMD MI355X cluster
AccBalanced · x · 2026-09-23
SemiAnalysis gave a shoutout to EmbeddedLLM, the lead maintainers and CODEOWNERS of vLLM ROCm. Until recently the team didn't even have persistent access to an MI355X cluster; only after SemiAnalysis worked with AMD leadership did they finally get a stable cluster to make MI355X great on AMD.
The episode highlights how AMD's inference ecosystem has long lacked sustained compute investment, and how vLLM's AMD support rests on a small third-party team.
Related event: EmbeddedLLM, vLLM ROCm maintainer, finally gets MI355X cluster(3 posts)→
More from Infra
- Activist evicted in 2024 puts $5B Maryland AI data center on hold — ATTlKA · 2026-11-12
- Agent Substrate Calculator Estimates Session Resume Speed Under Load — pjausovec · 2026-11-12
- Dell expands AI Data Platform: agents have a data-context problem, not a model problem — DavidLinthicum · 2026-11-12
- SGLang Megakernel Pushes Muse Spark to 1,109 tok/s, 2.1x Over Baseline — hsu_byron · 2026-11-12
- Potion UI's local login system turns your PC into a multi-user AI server — cocktailpeanut · 2026-11-12
- AWS Finally Built Its Own AWS Emulator — super_linear · 2026-11-12