RTX 5070 12GB Runs 177B Model Locally at 11-15 tok/s
A user demonstrated running Qwen's 177B model locally on a single RTX 5070 12GB with 32GB DDR4, achieving 11-15 tokens per second using llama.cpp expert-streaming optimization.
2026-10-03 ~ 2026-10-03 · 2 related posts
- Episode 1: Strata open-source engine runs 125B-parameter Qwen3.8-Flash-Next on consumer gaming PCs(2026-10-01, 7 posts)
- Episode 2: Strata Lets Consumer PCs Run 180B Models Locally(2026-10-02, 3 posts)
- Episode 3: RTX 5070 12GB Runs 177B Model Locally at 11-15 tok/s(2026-10-03, 2 posts)
- Episode 4: Strata runs 125B-parameter Qwen model on 12GB GPUs(2026-10-03, 2 posts)
- Qwen 177B at 11-15 tok/s on a Single RTX 5070 12GB: Expert Streaming Deep Dive — ayobluestarr · 2026-10-03
1 near-duplicate retellings: ayobluestarr