Hugging Face livestream today: model quantization with llama.cpp and vLLM
ben_burtenshaw · x · 2026-11-10
Hugging Face is hosting a quantization-themed livestream today featuring Merve Noyan, Maxime Labonne, Aditya Tadimeti, bartowski, and mgoin — a primer on shrinking models to fit on laptops, covering hands-on quantization know-how with llama.cpp and vLLM. Useful for developers running LLMs locally.
More from Infra
- CoreWeave details its open source contributions to vLLM, llm-d and Kubernetes at KubeCon — PyTorch · 2026-11-11
- turbopuffer ships CJK tokenizers; dev shares hard-won Chinese/Japanese/Korean search tuning tips — bo_wangbo · 2026-11-11
- Visualized: GLM 5.3 decode offload reads 13GB of weights plus experts per token — HankYeomans · 2026-11-11
- Anthropic chart shows 12x YoY revenue growth and ~$81B run-rate with 4x compute-efficiency gains — firstadopter · 2026-11-11
- Nvidia's biggest Southeast Asian partner imported far more AI chips than Nvidia saw in its data centers — nmasc_ · 2026-11-11
- AMD hits all-time high as traders hedge NVIDIA risk in AI buildout — BenBajarin · 2026-11-11