Thinking Machines Lab ships Inkling 2 Mini: looped MoE with 3B active params for local setups
ariG23498 · x · 2026-11-21
Thinking Machines Lab released Inkling 2 Mini on Hugging Face, a looped-transformer multimodal MoE with 26B total and 3B active parameters per token. Some layers loop three times to boost effective capacity; it supports 1M-token context and image+text input. Ships in mixed precision with NVFP4/MXFP8 expert weights plus a DSpark drafter for speculative decoding, and runs locally via transformers, llama.cpp, SGLang, and MLX.
More from Models
- Model "personality" is the second axis, and Google's data curation is winning it — iruletheworldmo · 2026-11-21
- Microsoft wraps Ignite by launching MAI Code 2, Cyber 2 Flash, Image 2.7 and more — SchoeneggerPhil · 2026-11-21
- Mech interp hackathon derailed as everyone freaks out over Claude solving Riemann hypothesis — burny_tech · 2026-11-21
- Ollama CEO in Fortune: enterprise demand for open models keeps growing — ycombinator · 2026-11-21
- vLLM day-0 support for looped Inkling: 2.68x faster decode on GB200 with 78% fewer kernels — vllm_project · 2026-11-21
- vLLM ships day-0 support for Thinking Machines' new looped Inkling model — vllm_project · 2026-11-21