llama.cpp v0.4.0 ships Qwen3.8-Flash-Next support, sparse flash attention, and RDMA
solyarisoftware · x · 2026-09-05
llama.cpp released v0.4.0 with notable additions:
- Initial architecture support for Qwen3.8-Flash-Next (qwen4exp) and NVIDIA Nemotron-3-Puzzle-75B-A9B
- New llamalazymode for on-demand tensor reading
- Per-slot server context limits
- Multimodal video input options and new mtmd APIs
- ggml bumped to 0.23.0 with major sparse flash attention and RDMA work
Also includes session/state version bumps and a maxbufsize quantization parameter.
More from Infra
- llama.cpp team launches Llama: one-click local AI on your Mac menu bar — Hugging Face · 2026-10-23
- China's daily token use hits 500T, up 4x as average price doubles to ¥13.46 — teortaxesTex · 2026-10-23
- New all-reduce kernels deliver 12% decode speedup for DeepSeek-V4.1 on PCIe-connected GPUs — AlpinDale · 2026-10-23
- Offshore oil rigs could be converted into AI data centers powered by stranded gas — clemnt · 2026-10-23
- Same native UI, two stacks: Swift build is ~80MB Mac-only, Zig build is ~10MB cross-platform — jedisct1 · 2026-10-23
- SurfSense: an open-source local NotebookLM with MCP agents and a prompt-caching lesson — FurtiveMirth · 2026-10-23