llama.cpp Vulkan SCALE fix PR #32735 delivers 2.3-3.2x speedup on Radeon R9700

pmttyji · reddit · 2026-11-22

Revertron's llama.cpp PR #32735 (vulkan: support non-contiguous src in SCALE) yields massive gains. Benchmarked with Inkling-2-Mini-UD-Q8KXL.gguf on a Radeon AI PRO R9700: pp512 jumps from 507.3 to 1604.8 tok/s (3.2x), tg128 from 19.1 to 53.8 tok/s (2.8x), and at d16384 depth pp512/tg128 improve 2.3x/2.5x. Tested via llama-bench -ngl 99 -fa 1 -ctk q80 -ctv q80.

Original post →

More from Infra

Infra channel →