Running quantized Inkling on a 5-year-old laptop: pre-AGI perks go off-grid

teortaxesTex · x · 2026-11-21

The poster runs Unsloth's UD-Q8KXL quant of Inkling on a 5-year-old laptop, musing that even old hardware gets pre-AGI perks — with a few TBs of knowledge you could survive off-grid (not that it would help much). He notes the quant is really BF16 dense + NVFP4 experts, so performance on his machine was laughable.

The screenshot shows Inkling-2-Mini reading a DeepSeek 'Code Agent Data Engineer' job posting (Beijing, Model Data Strategy) at 12.4 tok/s and accurately summarizing it: building RL environments from real-world coding/cybersecurity/research scenarios, with Code/Cybersecurity/Science tracks.

Related event: Quantized Inkling Runs on Old Laptops, Metal Inference 5.8x Faster After Requantization(2 posts)→

Original post →

More from Infra

Infra channel →