Inkling 2 Mini IQ4_NL hits 44 tok/s on an RTX 5060 Ti 16GB — llama.cpp params included

bobaburger · reddit · 2026-11-22

Reddit user bobaburger benchmarked Inkling 2 Mini (IQ4NL GGUF from ggml-org on HF) on an RTX 5060 Ti 16GB + 32GB RAM, tuning from 12 tok/s up to 44 tok/s at 128k context without vision, on latest llama.cpp.

Reproducible settings:

Related event: Inkling 2 Mini sparks local testing wave: strong coding model runs on 16GB VRAM(9 posts)→

Original post →

More from Infra

Infra channel →