Yandex open-sources 80B MoE Alice model: 3B active params, 256K context
teortaxesTex · x · 2026-09-22
Yandex has released the weights of its Alice AI Foundation 80B-A3B Base: 80B total parameters with only 3B active per token, 256K context, Apache 2.0 license, available on Hugging Face.
Commenter teortaxesTex notes this is a modern small MoE (Muon, Kimi Delta-style, AttnRes, Qwen3 Next-shaped, 18T tokens) from a country that can't legally buy compute and lost most of its AI researchers in five years — estimating Yandex is 1.5 years behind as an AGI lab, roughly at Mistral's level.
Related event: Yandex Open-Sources AliceAI 80B MoE Model with 256K Context(3 posts)→
More from Models
- Why Is Inkling 2 Small Trained on So Few Tokens Yet Still Competitive? — georgejrjrjr · 2026-11-12
- OpenAI's five biggest failures laid out: pretraining decline, alignment fears, enterprise lost to Claude — teortaxesTex · 2026-11-12
- Fable 5.2 Hits 41.3% on Remote Labor Index, Up From 2.5% a Year Ago — alliekmiller · 2026-11-12
- Beaker automates MIT's weight-space programming: one-neuron edit lifts MATH-500 from 7% to 37% for under $4 — VictorSanh · 2026-11-12
- Researcher says Anthropic dodged questions on Mythos false positive rate; 37,966 findings, 2 exploited — OwariDa · 2026-11-12
- Grok spotted building meeting "Listen to Conversation" feature with live transcript — nima_owji · 2026-11-12