Strata Lets Consumer PCs Run 180B Models Locally

The open-source Strata engine enables running large models on consumer hardware: users report 200 tok/s for Qwen3.8-Flash on an RTX 5090 with 96GB RAM, and 40-50 tok/s for the 180B Qwen3.8-Flash-Next with just 64GB RAM and 16GB VRAM.

2026-10-02 ~ 2026-10-03 · 3 related posts

Full story(4 episodes)→