Free Course: Build an LLM Inference Engine with Swift and Metal
WesEklund · x · 2026-07-14
The author has released LeetLLM, a free, problem-oriented course designed to build a small LLM inference engine on Apple Silicon using Swift + Metal.
The course consists of 48 lessons, covering topics from:
- Dot products and GEMV
- Attention mechanisms
- Token generation
It progresses all the way to the complete inference pipeline. The author actively welcomes feedback.
More from Infra
- Two-hour workshop covers open models, benchmark cheating, reward hacking and quantization — danielhanchen · 2026-07-21
- Nativ brings local AI model running to Mac with a desktop app and localhost API — Simon Willison · 2026-07-21
- Octen says agent search now runs at 62ms P50 with only a 6ms P90 gap — aakashgupta · 2026-07-21
- Zhipu acquires a compiler-team spinout to optimize AI inference on domestic chips — zephyr_z9 · 2026-07-21
- Open reproduction of Meta’s REWIRE data pipeline cuts the cost to about $11 — vanstriendaniel · 2026-07-21
- NeurIPS 2026 workshop will focus on on-device intelligence and local execution — YiMaTweets · 2026-07-21