Strata Lets Consumer PCs Run 180B Models Locally
The open-source Strata engine enables running large models on consumer hardware: users report 200 tok/s for Qwen3.8-Flash on an RTX 5090 with 96GB RAM, and 40-50 tok/s for the 180B Qwen3.8-Flash-Next with just 64GB RAM and 16GB VRAM.
2026-10-02 ~ 2026-10-03 · 3 related posts
- Episode 1: Strata open-source engine runs 125B-parameter Qwen3.8-Flash-Next on consumer gaming PCs(2026-10-01, 7 posts)
- Episode 2: Strata Lets Consumer PCs Run 180B Models Locally(2026-10-02, 3 posts)
- Episode 3: RTX 5070 12GB Runs 177B Model Locally at 11-15 tok/s(2026-10-03, 2 posts)
- Episode 4: Strata runs 125B-parameter Qwen model on 12GB GPUs(2026-10-03, 2 posts)
- Power-limited 5090 + 96GB DDR5 hits 150-200 tok/s decode on Qwen3.8-Flash-Next locally — z0_o6 · 2026-10-02
- Running 180B Qwen3.8-Flash-Next at 40-50 t/s on 64GB RAM + 16GB VRAM with Strata — danamir_ · 2026-10-03
- Strata runs a 125B model on a 12GB GPU at 96 tok/s, one-click local install — daluoseo · 2026-10-03