Aurora-80K releases: A modern tiny LLM with 80K params
Tall_Abrocoma_3533 · reddit · 2026-08-20
The author released Aurora-80K, a small language model with exactly 80,000 parameters. Despite its tiny size, it uses a factorized vocabulary of 4,096 tokens.
Benchmarks:
- Wikitext-2 BPB: 3.2902
- BLiMP: 52.31%
- Arc-Easy: 26.05%
More details are available on the Hugging Face model page.
More from Models
- Open Weights Models Face UX Friction; Both Closed and Open Will Grow — JosephJacks_ · 2026-08-21
- OpenAI's 'math breakthrough' criticized: real work is prompt engineering — gerardsans · 2026-08-21
- User tests ChatGPT browser vs Codex: faster and better writing — jasondeanlee · 2026-08-21
- Speculation: Google to announce new Gemma model at SF event — Porespellar · 2026-08-21
- DeepSeek Flash usage up 10-100x due to ultra-cheap inference — bindureddy · 2026-08-21
- DeepSeek V4 tested with poor aesthetics, suspected hidden CoTs — teortaxesTex · 2026-08-21