Building a From-Scratch Computer That Runs a 107K-Parameter Language Model
tetsuoai · x · 2026-09-24
The author is building a computer from scratch with Grok 4.7 (specs via Opus 5.5), themed after the golem legend:
- Golem-16 CPU: one instruction format, 8 registers, and a 40-bit MAC borrowed from 80s DSP chips.
- Clay, a typeless language in the spirit of B, where every value is one 16-bit word, compiles to Golem assembly.
- Emet-107K language model: 2 layers, 4 attention heads, mostly 8-bit weights with single bit-shift rescales, fitting on two 1980s-sized EPROMs.
- At 10 MHz it should emit 10 characters per second, with registers visible as it thinks.
More from coding & agent
- Why inference speed will be AI products' biggest competitive edge in 1–2 years — itsOmSarraf_ · 2026-11-11
- What happened when I moved vector retrieval into Snowflake SQL instead of orchestrating RAG outside — dima806_dima · 2026-11-11
- OpenAI engineer runs Codex for 26 days straight hunting Atlantis, spawning "vibe archaeology" — Polymarket · 2026-11-11
- He replaced a $5,000/month ghostwriter with 11 Claude Skills and earned $47,000 from one post — aryanXmahajan · 2026-11-11
- Refero Styles ships 2,000+ DESIGN.md files to give Claude Code real design taste — bbssppllvv · 2026-11-11
- Agent circuit breaker: openclaw shorts bot halts itself after 3 failed experiments — Rich_Standard_1724 · 2026-11-11