Strata runs 125B-parameter Qwen model on 12GB GPUs
Strata, an MIT-licensed open-source inference engine with nearly 8k GitHub stars, runs the 125B-parameter Qwen3.8-Flash-Next locally on consumer GPUs with just 12GB VRAM, hitting 53 tok/s on an RTX 5070.
2026-10-03 ~ 2026-10-05 · 2 related posts
- Episode 1: Strata open-source engine runs 125B-parameter Qwen3.8-Flash-Next on consumer gaming PCs(2026-10-01, 7 posts)
- Episode 2: Strata Lets Consumer PCs Run 180B Models Locally(2026-10-02, 3 posts)
- Episode 3: RTX 5070 12GB Runs 177B Model Locally at 11-15 tok/s(2026-10-03, 2 posts)
- Episode 4: Strata runs 125B-parameter Qwen model on 12GB GPUs(2026-10-03, 2 posts)
- Open-source Strata runs a 125B-param Qwen model on a 12GB consumer GPU — lxfater · 2026-10-03
- MIT-licensed Strata runs Qwen3.8-Flash-Next (125B) locally at 53 tok/s on an RTX 5070 12GB — petrusenko_max · 2026-10-05