Aleph Alpha open-sources Kolibri: 78B params, 3.46B active, 1M context, Apache 2.0
josh_wills · x · 2026-10-04
Aleph Alpha released Kolibri, a European-built model with 78B total parameters but only 3.46B active, up to 1M-token context, with weights open under Apache 2.0. Its report also details pretraining data classifiers: a frozen Luxical model surprisingly outperformed fasttext despite their similar architectures.
More from Models
- Daniel Han publishes summary of LLM benchmarks you can actually trust — danielhanchen · 2026-10-06
- Claim Verification Benchmarks Mostly Test Retrieval, Not Reasoning, Finds 24K-Trace Study — deliprao · 2026-10-06
- COLM26 study: LLMs ace claim verification benchmarks by taking shortcuts, not verifying — deliprao · 2026-10-06
- Opus 5.5 uses 26k tokens vs Astra's 12k yet costs 23% less per task at equal AA score — ChrisGPT · 2026-10-06
- GPT-6 Astra claimed to be first AI crossing world-class astrophysics threshold — johnseach · 2026-10-06
- $500/mo AI subscription is huge money in Jakarta: PPP pricing debate — sujingshen · 2026-10-06