IBM open-sources Granite Switch 4.1: one endpoint for chat, decisions and speech

jacek2023 · reddit · 2026-10-16

IBM released Granite Switch 4.1 (Apache 2.0) in 30B and 8B sizes, a modular LLM that composes a base model (128K context), on-demand aLoRA adapters (decision, guardian-core) and a 470M speech-to-text encoder behind a single endpoint, controlled via chat-template control tokens. Backed by Transformers and vLLM. In the demo, a 3B variant plays Doom at 60-100 decisions/second — vs 10/s for the previously reported Jev — while narrating and answering questions. Preview bundles without audio and the granite-switch composition tool are also open-sourced.

Original post →

More from Models

Models channel →