Strata open-source engine runs 125B Qwen3.8-Flash-Next on gaming PCs, 5k stars in 8 days
alex_verem · x · 2026-10-02
Strata, an open-source inference engine built by a solo developer, runs the 125B-parameter Qwen3.8-Flash-Next on ordinary gaming PCs and hit 5,000+ GitHub stars in 8 days. Install is one double-click, or one prompt in Claude Code/Cursor. On an RTX 5070 it generates faster than you can read, supporting chat, coding, image input, and OpenAI/Anthropic-compatible local APIs for other apps and coding agents. Requirements: 12GB VRAM, 32GB RAM, 80GB disk. Free, no account, fully local.
More from Infra
- Ascend output could hit ~20M chips next year; memory and packaging, not logic, are the bottleneck — teortaxesTex · 2026-11-19
- AMD Loom boosts Qwen3.5-4B prefill up to 2.6x on Radeon 890M laptops — jfowers_amd · 2026-11-19
- Dev submits PR adding periodic checkpoints to GKE sandboxes so agents don't lose progress — yoimnotkesku · 2026-11-19
- AWS Lambda Adds GPU Support via Managed Instances for Inference and Media Workloads — DavidWells · 2026-11-19
- Nvidia Allegedly Made GPUs Artificially Scarce to Keep Prices Sky-High — GaryMarcus · 2026-11-19
- AWS adds private CA support to Bedrock AgentCore Identity for connecting agents to self-hosted IdPs — AWS ML Blog · 2026-11-19