Inkling 2 Mini hits 200 tok/s on RTX 5090 via vLLM with native NVFP4
VoidAsuka · x · 2026-11-22
A developer reports running Inkling 2 Mini with vLLM on an RTX 5090, getting 200 tok/s out of the box with native NVFP4 support. First impressions: very smooth, with more concise thinking compared to Qwen models.
More from Infra
- Why a $200 subscription can burn $100k of tokens: it's all about infra utilization — RexDouglass · 2026-11-22
- Redditor predicts cheap GPUs will return, 'only a matter of time' — ridhwanss · 2026-11-22
- Designer argues local LLMs are overrated; would buy a 5090 PC instead — AIandDesign · 2026-11-22
- An AI bubble fable: from free cash flow to private credit to annuity blowup — Svwang1 · 2026-11-22
- One RX 7900 XTX runs 524k context at 767 tok/s, 3x faster than llama.cpp — W61k3r · 2026-11-22
- How GPUs organize work: kernel launches, thread blocks and scheduling explained — blaizedsouza · 2026-11-22