86M-param decoder-only transformer plays chess on Lichess, full notebook public

andreisavu · x · 2026-10-29

Andrei Savu published a research notebook for LittlePly, an 85.9M-parameter decoder-only transformer chess model trained on a local Lambda Vector Workstation (with his OpenAI dot, Glimmer). It ingests full game histories and outputs next-move probabilities using a 128-token move codec (from/to/promotion), 12 decoder blocks, and a 1024-token context, with no reasoning trace; legal filtering and a disclosed three-ply mate helper complete the playing system. The bot plays on Lichess (up to 4 simultaneous games, bullet to classical), and models, datasets, and source are downloadable.

Original post →

More from coding & agent

coding & agent channel →