Building a Transformer lesson site by recording a 1.5B model's inner workings on a Mac

techartist_ · x · 2026-11-20

techartist explains how a Transformer teaching site was made: it started as a design page (ten lessons, colors, paper texture) before any code, then was built lesson by lesson with an AI.

The core trick: run a small open 1.5B-parameter model locally on a Mac and record what it does—the probability of every next token, which earlier words each word attends to, what each of its 28 layers guesses—then play those recordings back inside the lessons.

Related event: Developer Runs 1.5B Model Locally on Mac, Visualizing Attention Layer by Layer(2 posts)→

Original post →

More from Apps

Apps channel →