Quantized Inkling Runs on Old Laptops, Metal Inference 5.8x Faster After Requantization

Unsloth's Inkling UD-Q8KXL quantization combines BF16 dense weights with NVFP4 experts, and requantization yields a 5.8x Metal inference speedup. Users report running it locally even on five-year-old laptops.

2026-11-21 ~ 2026-11-21 · 2 related posts