Forked PolyStrata hits ~1000 tok/s prefill for small model on RX 6700 XT

ireallydontcare00 · reddit · 2026-11-23

The author forked the PolyStrata inference engine and tuned it for Inkling-2-Mini, benchmarking the UD-IQ4XS GGUF on an RDNA2-based RX 6700 XT:

No quality loss was reported, and the code is open-sourced for anyone to try.

Original post →

More from Infra

Infra channel →