Rust-Built QuixiInfer Runs DeepSeek MoE on a Single RTX 5090
QuixiAI released QuixiInfer, an open-source inference engine written from scratch in Rust that runs the 125B-parameter DeepSeek MoE model on a single RTX 5090, achieving 25-30 tok/s at 256k context length.
2026-11-20 ~ 2026-11-20 · 3 related posts
- QuixiInfer: from-scratch Rust engine runs DeepSeek with 256k context on a single RTX 5090 at ~30 tok/s — QuixiAI · 2026-11-20
- QuixiInfer: Rust Engine Runs 125B MoE Model on a Single RTX 5090 — QuixiAI · 2026-11-20
- QuixiInfer: Rust Inference Engine Runs DeepSeek with 256k Context on a Single 5090 at 25-30 tok/s — hotschmoe · 2026-11-20