36B MoE open model K2-Horizon with 4B active params ships as local-runnable GGUF
rupspace · x · 2026-09-05
A new open-weights text generation model, K2-Horizon-MoVA-36B-A4B, is now on Hugging Face: a 36B-total-parameter Mixture of Experts with only 4B active parameters, offering large-model capability at a fraction of the compute cost.
- Released as GGUF quantized checkpoints for local hardware
- Open weights, ready to download for self-hosted inference
More from Infra
- Mighty Heaton takes on the reasons you hate data centers — csuwildcat · 2026-09-05
- Extropic's Z1T models claim up to 140x energy efficiency over GPUs on probabilistic chips — beffjezos · 2026-09-05
- NVIDIA Nsight Compute Now Profiles CUDA Tile Kernels — Two Changes Cut Kernel Time 81% — NVIDIA Developer · 2026-09-05
- Beff Jezos says Alcatraz would make a fantastic spot for an AI datacenter — beffjezos · 2026-09-05
- Free tokens are fueling open-source and local AI, Jason argues citing Jensen — AccBalanced · 2026-09-05
- GPU Sandboxes as the Compute Primitive for Recursive Self-Improvement — AAAzzam · 2026-09-05