Project Maya v1.1.73 brings Inkling 2 Mini to 8GB GPUs, 144 tok/s on a 4090

teortaxesTex · x · 2026-11-22

Project Maya released v1.1.73, greatly expanding hardware support for Inkling 2 Mini:

User teortaxesTex reports an easy 144 tok/s on a 4090, calling it the first good model for a single-GPU box — though he still wants a true DeepSeek-Nano with an honest 1M context, noting the current 32K context already needs 1.2GB of cache.

Original post →

More from Infra

Infra channel →