Building a Transformer lesson site by recording a 1.5B model's inner workings on a Mac
techartist_ · x · 2026-11-20
techartist explains how a Transformer teaching site was made: it started as a design page (ten lessons, colors, paper texture) before any code, then was built lesson by lesson with an AI.
The core trick: run a small open 1.5B-parameter model locally on a Mac and record what it does—the probability of every next token, which earlier words each word attends to, what each of its 28 layers guesses—then play those recordings back inside the lessons.
More from Apps
- Saudi Arabia's HUMAIN launches Arabic-first voice AI platform HUMAIN Voice — HUMAIN · 2026-11-20
- Non-technical personal trainer ships production app built entirely with Claude in 3 months — simpsoka · 2026-11-20
- Musk amplifies Grok Bot phone-call demo highlighting live transcripts — elonmusk · 2026-11-20
- Affiliates exploit Google Docs for parasite SEO; Perplexity cited 154 Docs URLs in 42 answers — gaganghotra_ · 2026-11-20
- Dev spent two years of spare time building an iOS gift app, now live with Product Hunt launch — jakubzeg · 2026-11-20
- Fan-built 'ChatGPT FM' radio answers Claude's lo-fi stream — NoEmu9097 · 2026-11-20