Thinking Machines Open-Sources Inkling

Latent Space · rss · 2026-07-16

Latent Space summarized the first open-weight foundation model family, Inkling, released by Thinking Machines Lab.

Core Specs

• Inkling: MoE Transformer, approx. 975B total parameters / 41B active parameters
• Supports text, image, audio, with text output
• Pre-trained on approx. 45T tokens, with context lengths up to 1M
• Licensed under Apache 2.0
• A smaller variant, Inkling-Small (276B / 12B), is also available, focusing on lower cost and latency

Training & Architecture Highlights

• Trained from scratch, emphasizing controllable thinking/reasoning effort
• The community uncovered several architectural details from the materials:
• Mixed/sliding window attention
• Relative position encoding/relative attention bias
• Short convolution layers
• MoE + shared experts
• Load balancing scheme
• Multi-head design for speculative decoding

Performance & Positioning

• Artificial Analysis gave it an Intelligence Index of 41, calling it one of the leading US open-weight models currently available
• It also achieved strong rankings on leaderboards like the agentic / web app arena
• Multiple reviewers noted its solid performance in tool calling, long-horizon error correction, and concise reasoning, though it may not fully surpass top closed-source models across all multimodal and agentic benchmarks

Ecosystem

• Received ecosystem support from vLLM, SGLang, Modal, Baseten, Databricks, and Hugging Face on launch day
• Tinker platform and Playground are also available, supporting subsequent fine-tuning and usage

Original post →

More from Models

• OpenAI rolls out voice in GPT-Live, but the UI obscures search and reasoning — Graham_dePenros · 2026-07-22
• Gemini 3.6 Flash goes live in Antigravity with 17% fewer output tokens — rseroter · 2026-07-22
• Moonshot’s Kimi K3 sets a new open-weights ECI record at 156 — scaling01 · 2026-07-22
• Nanbeige4.2-3B launches as a 3B Looped Transformer model that beats larger baselines — Wooden-Deer-1276 · 2026-07-22
• A post says six companies now beat Google’s best LLM, including two open-source models — soham_btw · 2026-07-22
• Gemini 3.6 Flash benchmark results reignite concerns that Google is slipping behind — minxio_ · 2026-07-22

Models channel →