Strata repo: 125B Qwen3.8-Flash-Next on consumer hardware with local OpenAI/Anthropic APIs
alex_verem · x · 2026-10-02
This post links to the Strata GitHub repo. Strata runs the 125B-parameter Qwen3.8-Flash-Next on consumer hardware with one-click Windows/Linux install, local OpenAI/Anthropic-compatible APIs, and optional image input. Currently 5.7k stars; README shows a one-shot voxel scene on RTX 5070 with IQ3S quantization at 128K context. Same project as the previous tweet.
More from Infra
- Just 10% of people using AI heavily could strain inference infra as HBM costs skyrocket — XFreeze · 2026-10-03
- Critics Slam a "Neocloud": Wrapped RunPod Months Ago, No Colocated DCs — knowrohit07 · 2026-10-03
- Analyst Bullish on AAOI as 800G/1.6T Ramp; 3.2T Not Mainstream Yet — BenBajarin · 2026-10-03
- Google Dropped Its Tier 2 Spend Gate That Pushed a Dev to OpenRouter — vivekhaldar · 2026-10-03
- AMD: Software Tuning on MI355X Plus vLLM 0.30.1 Cuts MiniMax-M3 Token Cost by 31% — ryanshrout · 2026-10-03
- 4-GPU server topology: one Gen5 switch covers it, benchmark all-reduce before buying three — knowrohit07 · 2026-10-03