One-third into Raschka's 'Build an LLM From Scratch': great, but riddled with typos
phl43 · x · 2026-10-09
The author shares his take after reading about a third of Sebastian Raschka's Build a Large Language Model (From Scratch).
Verdict: after lots of reading on deep learning and LLMs, actually building one yourself proved far more instructive — he recommends the book.
Criticisms:
- Plenty of typos, which is ironic given how easily LLMs can detect and fix them;
- Not enough effort spent building intuition for how LLMs work — though ChatGPT filled that gap nicely, e.g. with a great explanation of self-attention.
More from Research
- RFD4-Proteina's 'underrated' docs detail partial diffusion for protein redesign — AllThingsApx · 2026-10-23
- MPI-Sec PhD Thesis on Vulnerability Detection Benchmarks Includes Pre-LLM Classic "Top Score on the Wrong Exam" — mboehme_ · 2026-10-23
- LiveNerf's 29-day data finds no nerfing of Claude Opus 5.5 — TheOnlyVibemaster · 2026-10-23
- New paper makes 9 falsifiable predictions toward a major AI-enabled terror attack by 2027-2028 — StephenLCasper · 2026-10-23
- HumanoidPose recovers humanoid robots' full-body joint states from RGB video alone — cholz · 2026-10-23
- Sophont's Holon-S1 predicts genes and biomarkers from routine pathology slides — iScienceLuvr · 2026-10-23