HF's Niels Rogge releases 'Getting Started with Local AI' slides: quantization, MoE, local agents

NielsRogge · x · 2026-11-09

Hugging Face engineer Niels Rogge published full slides from his 'Getting started with Local AI' talk at a Qatar hackathon, covering benefits of local AI, where to find the best open models, quantization basics, dense vs. MoE tradeoffs, and local agents (e.g. Pi + LFM3-1.7B-GGUF). A solid systematic primer for running models on-device.

Related event: Hugging Face Engineer Shares Local AI Starter Slides(2 posts)→

Original post →

More from coding & agent

coding & agent channel →