Same model, 20% faster and 16GB less RAM: Basalt beats Strata in hands-on local inference test
x_MASE_x · reddit · 2026-11-10
On a 12900K/128GB DDR4/5070Ti rig, the author compared Strata CLI 0.1.59 vs Basalt 0.3.2 with the same Qwen3.8-Flash-Next iq3s model at 256k context: Strata averaged 99.2 tps with 69.2GB RAM, felt sluggish between phases, failed to compact and couldn't finish tasks; Basalt hit 100-118 tps (peaking 145) with 53GB RAM, ran smoothly and reliably completed projects. Basalt is now a genuinely dependable local setup; nvfp4 tests are next.
Related event: Real-World Test: Basalt Beats Strata by 20% in Speed and Stability on 128GB(2 posts)→
More from Infra
- Visualized: GLM 5.3 decode offload reads 13GB of weights plus experts per token — HankYeomans · 2026-11-11
- Anthropic chart shows 12x YoY revenue growth and ~$81B run-rate with 4x compute-efficiency gains — firstadopter · 2026-11-11
- Nvidia's biggest Southeast Asian partner imported far more AI chips than Nvidia saw in its data centers — nmasc_ · 2026-11-11
- AMD hits all-time high as traders hedge NVIDIA risk in AI buildout — BenBajarin · 2026-11-11
- Rain launches Agent Vaults to embed agentic payments into any app — ai · 2026-11-11
- Google broadens TPU lineup with two new specialized chips for confidential training and bigger memory — TechCrunch AI · 2026-11-10