Inkling 2 Mini reasoning model gets a GGUF build for local use
kalyan_kpl · x · 2026-11-23
A GGUF quantized version of the Inkling 2 Mini model is now on Hugging Face (AtomicChat/Inkling-2-Mini-GGUF) for local deployment. Its chat template reveals a tunable reasoningeffort parameter (0–0.99) plus tool declaration support.
More from Models
- Tesla demos FSD v15 autonomously navigating around a tree blocking the road — ZeroStateReflex · 2026-11-23
- Uncensored 26.4B model runs on a 12GB Mac at 85 tok/s with 8 parallel agents via Locals — SumitGup · 2026-11-23
- Princeton's SSoN Benchmark: Best Vision Model Scores 39.7% vs Human 83.3% on Spatial Consistency — jiqizhixin · 2026-11-23
- Dev: 99% of people shouldn't self-host local LLMs, and he only does it for the hardware — gnukeith · 2026-11-23
- Theo says open models trail by 7.5 months; GLM-5.5 and Kimi-K3.5 may flip the story — scaling01 · 2026-11-23
- Baidu open-sources Unlimited OCR2, an OCR model that parses entire books in one request — abhishek__AI · 2026-11-23