AMD Loom boosts Qwen3.5-4B prefill up to 2.6x on Radeon 890M laptops
jfowers_amd · reddit · 2026-11-19
An AMD engineer shares benchmarks of the new Loom inference stack optimizing Qwen3.5-4B (Q4KM) on a Radeon 890M (gfx1150) laptop: up to 2.6x prefill speedup (1041 tok/s at 16k) and 1.18-1.47x decode gains over llama.cpp ROCm/Vulkan, with 4 concurrent streams at 82.3 tok/s. Model cards and quick-start guides cover gfx1150, Strix Halo and RDNA4 GPUs.
More from Infra
- Dev submits PR adding periodic checkpoints to GKE sandboxes so agents don't lose progress — yoimnotkesku · 2026-11-19
- AWS Lambda Adds GPU Support via Managed Instances for Inference and Media Workloads — DavidWells · 2026-11-19
- Nvidia Allegedly Made GPUs Artificially Scarce to Keep Prices Sky-High — GaryMarcus · 2026-11-19
- AWS adds private CA support to Bedrock AgentCore Identity for connecting agents to self-hosted IdPs — AWS ML Blog · 2026-11-19
- Leak Hints at Classified 1M-GPU Training Cluster in China That Skips HBM — teortaxesTex · 2026-11-19
- Tencent leaned on Japanese neocloud for AI compute; DeepSeek, Zhipu best positioned — teortaxesTex · 2026-11-19