Minimind: Train a 64M-parameter LLM from scratch in just 2h
jingyaogong · github · 2026-08-31
GitHub project jingyaogong/minimind provides a complete codebase and tutorial to train a small 64M-parameter Large Language Model from scratch in just 2 hours. It is suitable for learning LLM training workflows and principles.
More from Research
- Interpretability debate: one interpretable polysemantic neuron doesn't prove all are — aran_nayebi · 2026-10-16
- Optuna creator Akiba: when 2 hyperparameters cost $20M, what's left for BO/HPO — Stefania_druga · 2026-10-16
- AI will be superhuman at science regardless, and Europe can't opt out — teortaxesTex · 2026-10-16
- SERO augments long-horizon agentic RL with executable oracle continuations — Shanghai-AI-Laboratory · 2026-10-16
- Tsinghua and Amap propose OmniVerifier-C1, a graded verifier beating binary judges — Bowei Liu · 2026-10-16
- Alibaba open-sources MAI-Gym, an all-in-one GUI agent eval and RL training platform — Tongyi-MAI · 2026-10-16