Custom llama.cpp Branch Adds Expert Expansion for MoE Models
Specific-Tax-6700 · reddit · 2026-09-07
A developer built a custom branch of llama.cpp (with help from GLM 5.3 Flash) that supports expert expansion for MoE models. Tested only on Metal so far, and it works better than the author's earlier DS4 version.
The branch is open-sourced with docs, and the author is looking for feedback from other platforms and different models.
- Docs: moe-expansion branch
More from Infra
- SurfSense: an open-source local NotebookLM with MCP agents and a prompt-caching lesson — FurtiveMirth · 2026-10-23
- Meta researcher: horrifying infra, not talent, is why OSS can't catch closed frontier — A_K_Nain · 2026-10-23
- Jane Street and NVIDIA speed up Mamba-2 with custom cuTile kernels — blelbach · 2026-10-23
- LatentLoop: asymmetric compute allocation cuts looped-MoE training cost by 19% — pmttyji · 2026-10-23
- Same AI request emits 8.5x more CO2 in Texas than in Sweden — jlundberg · 2026-10-23
- SK Hynix Pulls Plug on Solidigm US IPO as Chip Stocks Slide, Shares Down ~30% This Quarter — rohanpaul_ai · 2026-10-23