Inkling 2 Mini quantized to 5.4GB/8.9GB, keeping 91-97% performance

teortaxesTex · x · 2026-11-21

Inkling 2 Mini — the open-weights model leading every sub-100B-total-parameter model on benchmarks like DeepSWE v1.1 (48.2%) and Vals Index v2.2 (46.5%), with 5.4B effective activations per token — now has quantized builds: shinboson released 5.4GB and 8.9GB versions retaining 91.2% and 96.8% of original performance respectively. A faster-drafter version and an iPhone version are coming soon. Good news for RAM-constrained local deployment.

Original post →

More from Infra

Infra channel →