Aurora-80K releases: A modern tiny LLM with 80K params
Tall_Abrocoma_3533 · reddit · 2026-08-20
The author released Aurora-80K, a small language model with exactly 80,000 parameters. Despite its tiny size, it uses a factorized vocabulary of 4,096 tokens.
Benchmarks:
- Wikitext-2 BPB: 3.2902
- BLiMP: 52.31%
- Arc-Easy: 26.05%
More details are available on the Hugging Face model page.
More from Models
- Decision models match LLMs on routing and safety — and are 7-8x faster — randal_olson · 2026-10-16
- Xiaomi MiMo V2.6 Pro takes #1 open-model spot on Agent Arena at $0.11/task — arena · 2026-10-16
- ChatGPT's 'best AI video tool' answer points to Runway integration, sparking ad doubts — tlakomy · 2026-10-16
- Microsoft's MAI finishes in-house 3T-parameter pretrained base models, post-training results coming — soumitrashukla9 · 2026-10-16
- Hands-on with Gemini 4 Argon: faster than Opus 5.5 but hallucinates more and costs more — prasenx · 2026-10-16
- Bindu Reddy urges Meta to open-source Wonder, claiming it beats DeepSeek — bindureddy · 2026-10-16