GLM 5.2 Hits 2626 tok/s on a Single AMD MI355X Node
burny_tech · x · 2026-07-05
According to waferai (which hit #2 on Hacker News), engineers successfully deployed and served GLM 5.2 on AMD MI355X. The single-node throughput reached 2626 tok/s, with about 213 tok/s per user, demonstrating the potential of non-Nvidia hardware for open-source large model inference.
Related event: GLM 5.2 Achieves 2626 tok/s Inference on AMD MI355X(2 posts)→
More from Infra
- Nvidia gets mocked as “the leading open-source AI company” while repo chart shows it ahead — AccBalanced · 2026-07-27
- $8 ESP32-S3 runs a 28.9M-parameter LLM fully offline at 9.5 tokens per second — yangyi · 2026-07-27
- YC talk on BCI x AI says infrastructure is what really determines speed — garrytan · 2026-07-27
- A 13B model ran on a no-GPU PC by paging weights from SSD via llama.cpp — ID_R_McGregor · 2026-07-27
- llama.cpp warns that GGUFs made before a recent change must be regenerated — EconomySerious · 2026-07-27
- RTX 5090 local tests show Qwen Q6 can drop to 15 tok/s at 80k context — LFAdvice7984 · 2026-07-27