Will MoE Inkling 2 Mini get strata support and rival dense Qwen on 12GB VRAM?
ECrispy · reddit · 2026-11-21
A Reddit user discusses Inkling 2 Mini: as an MoE model being compared against the dense Qwen 27B, with claims of good quantization and higher tokens/sec, they ask whether upcoming strata support could let it run at Qwen-27B-rivaling speeds on modest hardware (12–16GB VRAM, 32GB RAM) for GPU-poor users.
More from Infra
- Sarvam resells DeepSeek in India, drawing backlash over AI sovereignty stance — teortaxesTex · 2026-11-21
- Ilya Sutskever warns weak neocloud security could let rogue agents hijack compute — npinto · 2026-11-21
- Colfax and MIT speed up lattice QCD staple networks 700–1200x on H200 with CuTe DSL — snowclipsed · 2026-11-21
- 'Computers Have Broken Everything': NYT on America's growing tech fragility — nordicinst · 2026-11-21
- Can foundries build photonic processors with unclonable fingerprints? — jwt0625 · 2026-11-21
- Optical waveguide crossing lets light pass through while keeping circuits electrically isolated — jwt0625 · 2026-11-21