DeepSeek Writes Custom Metal Kernel for Kimi in 50 Minutes
technaturalism · reddit · 2026-08-09
While running a quantized DeepSeek model on a Mac Studio (512GB), a developer realized there was no existing Metal kernel on GitHub for Unsloth's ultra-low bit quantization of Kimi K2/K3. They decided to let the model write one itself.
The model successfully wrote a custom Metal kernel in about 50 minutes. Although the performance is mediocre, it is significantly better than pure CPU compute, achieving around 4 t/s decode and 20 t/s prefill on the K3 Q10 quantization. The author expressed amazement at the coding capabilities demonstrated by the model at such a low bit quant level.
More from coding & agent
- ComfyUI-SigmaSync-LoRA: Schedule LoRA Strength Against Sampler SIGMAS — Capitan01R- · 2026-08-09
- Prime Agent: Open-Source Self-Improving RLM Agent for Coding, 2,293 Stars in 24h — Roger_M_Taylor · 2026-08-09
- NVIDIA Open-Sources NOOA: An Agent Framework Treating Agents as Python Classes — AccBalanced · 2026-08-09
- Lonkero: Modular Rust Web Security Scanner with ML Integration — tom_doerr · 2026-08-09
- Optimizing Video Generation on RTX 3090: Low-Res Generation and Upscaling — cocktailpeanut · 2026-08-09
- Reproducing Papers to Code: RepLLM Multi-Agent Framework — jiqizhixin · 2026-08-09