Running Hy4-Flash locally on 2x RTX 3090: Q3 quant hits PP 63 / TG 22 tokens per second

EmilPi · reddit · 2026-11-19

The author benchmarked AngelSlim's Hy4-Flash-GGUF Q3K quant on llama-server with 2x RTX 3090 + 128GB DDR4, calling it a genuine rival to DSv4-Vision-Exp and Qwen3.8-27B-Uncensored, finishing answers with fewer tokens despite being slower.

Key setup and results:

Full config file excerpt and command line included, easy to reproduce.

Original post →

More from Infra

Infra channel →