Building a From-Scratch Computer That Runs a 107K-Parameter Language Model
tetsuoai · x · 2026-09-24
The author is building a computer from scratch with Grok 4.7 (specs via Opus 5.5), themed after the golem legend:
- Golem-16 CPU: one instruction format, 8 registers, and a 40-bit MAC borrowed from 80s DSP chips.
- Clay, a typeless language in the spirit of B, where every value is one 16-bit word, compiles to Golem assembly.
- Emet-107K language model: 2 layers, 4 attention heads, mostly 8-bit weights with single bit-shift rescales, fitting on two 1980s-sized EPROMs.
- At 10 MHz it should emit 10 characters per second, with registers visible as it thinks.
More from coding & agent
- GPT-6 Astra Fixes a UI That Even Opus 5.5 Couldn't Crack — haltakov · 2026-09-24
- Kimi client patches arbitrary-command vulnerability via local embedded server — KimiDevs · 2026-09-24
- Codex computer use drives iPhone via Mac mirroring, fast and undetected — op7418 · 2026-09-24
- Kimi Code Desktop 1.0.3 adds built-in browser for local HTML files — KimiDevs · 2026-09-24
- PowerShell GridView rebuilt with AI on Go Wails: live search, sorting, multi-select — dfinke · 2026-09-24
- In-house multi-vec retriever crushes API dense retrievers on memory search, ColBERT next? — bo_wangbo · 2026-09-24