Hands-on: AMD ROCm 10.2 delivers 2.2x token throughput on Qwen3.8-27B

AnushElangovan · x · 2026-11-21

A tester running a local data center reports AMD's newly released ROCm 10.2 stack — positioned as a CUDA alternative — is "legit": on AMD GPUs with multi-lane concurrency, Qwen3.8-27B saw 2.2x token throughput. Tests on Qwen3.8-Flash-Next are underway with early numbers looking "ridiculously good." If reproducible, it's a notable step for AMD on LLM inference.

Original post →

More from Infra

Infra channel →