Microsoft's 2.3B Aion Instruct hints every Windows device will ship with an on-device LLM by 2027

NielsRogge · x · 2026-11-19

Microsoft released Aion Instruct on Hugging Face: a 2.3B-parameter small language model built for on-device AI in Windows, with a 32K context window and support for 8 languages.

The model card states that "a further optimized version of Aion Instruct, coupled with Microsoft's content moderation model, will become the Windows OS SLM by the end of January 2027." Hugging Face's NielsRogge reads this as Microsoft planning to ship an LLM on every Windows device.

Related event: Microsoft releases Aion-1.0-Instruct-2.3B for on-device Windows AI(3 posts)→

Original post →

More from Models

Models channel →