Qwen 177B at 11-15 tok/s on a single RTX 5070 12GB via expert-streaming tweaks

ayobluestarr · reddit · 2026-10-03

A detailed writeup of running Qwen3.8-Flash-Next 177B (UD-IQ3XXS) on an RTX 5070 12GB with 32GB DDR4 and a Ryzen 5 5600GT using a llama.cpp expert-streaming setup: 11.5 tok/s in benchmarks (up from 7), 14-15 tok/s in normal chat, and a 4,892-token coding prompt at 10.15 tok/s producing a working single-file Snake game.

Key optimizations:

The author is soliciting suggestions, especially around streaming.

Related event: RTX 5070 12GB Runs 177B Model Locally at 11-15 tok/s(2 posts)→

Original post →

More from Infra

Infra channel →