TensorFold: a Zig LLM inference engine spanning Metal, CUDA and Vulkan
ashhart · github · 2026-11-12
TensorFold is an LLM inference engine written in Zig that supports Metal, CUDA, and Vulkan backends, covering Apple silicon, NVIDIA GPUs, and cross-platform Vulkan devices.
The repo sits at 1,823 stars (+58 today) with 148 contributors and 386 forks, gaining traction in the crowded local inference engine space.
More from Infra
- SpaceX's Southaven data centers net local schools and county $63M a year — 0xAllen_ · 2026-11-12
- Quantum infrastructure firm Q-CTRL announces Series C led by Salesforce Ventures — MJBiercuk · 2026-11-12
- Voxel pagoda generated fully local on a GPU-less 2020 ThinkPad with a 35B MoE model — dai_app · 2026-11-12
- Nebius Q3: $12B in customer commitments, revenue up 68% to $981M as GPU prices climb 22% — demian_ai · 2026-11-12
- 1T-Parameter MoE trained on EU public supercomputer with PyTorch, per-GPU throughput up 14x — PyTorch · 2026-11-12
- llama.cpp crosses 134k GitHub stars as the default local LLM inference stack — ggml-org · 2026-11-12