RustingStrata vs Strata on RTX 3060: Rust MoE engine edges out 28.3 vs 26.1 tok/s

Serious_Scarcity7818 · reddit · 2026-11-19

The author benchmarked his pure-Rust GGUF engine RustingStrata against Strata v0.2.13.1 running Qwen3.8-Flash-Next (experts split between VRAM and SSD) on an RTX 3060 12GB:

RustingStrata is a general engine: one Rust binary, no Python/C++ build, CUDA kernels compiled on first start, same kernels on Vulkan (AMD/old NVIDIA), broader model support (Qwen3, GLM-5.3-Flash, Gemma 4, etc.), IQ1S–Q80 quants, vision input, runtime LoRA, dual-GPU layer split, OpenAI/Anthropic APIs and an MCP-capable chat page. Full launch commands for both engines are included.

Original post →

More from Infra

Infra channel →