Will MoE Inkling 2 Mini get strata support and rival dense Qwen on 12GB VRAM?

ECrispy · reddit · 2026-11-21

A Reddit user discusses Inkling 2 Mini: as an MoE model being compared against the dense Qwen 27B, with claims of good quantization and higher tokens/sec, they ask whether upcoming strata support could let it run at Qwen-27B-rivaling speeds on modest hardware (12–16GB VRAM, 32GB RAM) for GPU-poor users.

Original post →

More from Infra

Infra channel →