Aurora1.0, a 150M open model trained on 7B tokens, matches GPT-2-Small
Tall_Abrocoma_3533 · reddit · 2026-09-14
The author released Aurora1.0, a first-generation 150M-parameter open model matching GPT-2-Small, trained on 7B tokens with a single RTX Pro 6000.
Benchmarks: PIQA 62.24%, HellaSwag 32.20%, ARC-Easy 44.91%, ARC-Challenge 25.00%, Arithmark 3.0 33.90%, CapitalBench 36.55%.
An example inference script is available in the Hugging Face repo.
More from Models
- Leak: Google Reportedly Has Another 'Hella Chonky' Model After Carbon — iruletheworldmo · 2026-10-30
- Users report across-the-board GPT quality drop: weaker writing and broken instruction following — Kyrannio · 2026-10-30
- Leak claims Gemini Argon hits Pro trial from November 2nd (unverified) — Emotional-Company847 · 2026-10-30
- OpenAI retiring waves of legacy models: GPT-5 family dies Dec 11, GPT-4.1 by Jan 2027 — ThePeterMick · 2026-10-30
- DeepMind CEO Demis Hassabis tells Musk: testing with trusted partners, coming soon — demishassabis · 2026-10-30
- Adobe stands firm on not training on customer data, using licensed stock instead — omooretweets · 2026-10-30