Solo Dev Ships LexiSuite, a Rust OS/Engine Claiming 5-25% Over llama.cpp on AMD
W61k3r · reddit · 2026-11-09
A solo developer built LexiSuite: a bootable all-Rust OS/engine/kernel with tuning and training management, running kernel 7.4 rc1 by default. Key claims: the engine runs Qwen3.8 27b on a 7900xtx (Vulkan) 5-25% faster than llama.cpp losslessly, using 91% of card bandwidth vs 80%. Code targets NVIDIA, Intel, AMD and Chinese hardware, supports 20 languages. Flash to USB with balenaEtcher and boot. Numbers are author-reported and unverified.
More from Infra
- Batch APIs: the 50% LLM discount only pays off after model choice and prompt caching — arpit_bhayani · 2026-11-13
- RTX Pro 6000 bricks mid-Qwen run, owner jokes it "died of a broken heart" over Jensen news — wine_dark · 2026-11-13
- Bittensor's Chutes Handles 256 Concurrent Requests on a Single RTX 5090 at ~18k tok/s — markjeffrey · 2026-11-13
- Google expands TPU v8 lineup: 8tx cuts latency 2x, 8i Max doubles silicon per rack — Beth_Kindig · 2026-11-13
- Horace He to share two mental models for reasoning about inference at SGLang Summit — cHHillee · 2026-11-13
- Used A100 prices fall another 20-30% as sellers rush ahead of a collapse — Bascilian · 2026-11-13