QuixiInfer: Rust Engine Runs 125B MoE Model on a Single RTX 5090

QuixiAI · x · 2026-11-20

QuixiAI released QuixiInfer, an open-source inference engine written from scratch in Rust that serves Qwen3.8-Flash-Next (125B MoE, 512 experts per layer, 262k context) from a single workstation: one RTX 5090 (32GB), a 16-core CPU, 128GB RAM and an NVMe SSD.

Original post →

More from Infra

Infra channel →