Custom Rust engine runs 524k context on a single RX 7900 XTX
A developer ran Inkling-2-Mini with 524,288-token context on a single 24GB RX 7900 XTX using a custom Rust/Vulkan engine, achieving 3-5x the speed of llama.cpp.
2026-11-22 ~ 2026-11-22 · 2 related posts
- Custom Rust engine runs Inkling-2-Mini at 524k context on one 24GB GPU, ~5x faster than llama.cpp — W61k3r · 2026-11-22
- One RX 7900 XTX runs 524k context at 767 tok/s, 3x faster than llama.cpp — W61k3r · 2026-11-22