Strata 0.2.19 runs Inkling 2 Mini locally: 11,306 tokens/s prefill on RTX 5090

CurieuxExplorer · x · 2026-11-23

Strata 0.2.19 adds native support for Thinking Machines Lab's Inkling 2 Mini, a 26.4B-parameter looped MoE model (3.4B active per token, 1M context, text+image input, OpenAI-compatible tool calling), running locally on Windows, Linux, Apple Silicon, Intel Arc, and DGX Spark.

Original post →

More from Infra

Infra channel →