Eureka Machine auto-writes a Metal megakernel fusing Flint's entire decode pass on M4/M5
hardmaru · x · 2026-10-22
- Recursive AI's Eureka Machine now writes entire megakernels: it fuses Flint's whole decode pass into a single Metal kernel on M4/M5 Macs — every layer, attention, low-bit projections, expert routing, and output head.
- Metal is Apple's GPU language; full fusion cuts kernel-launch and memory overhead. Code is open-sourced.
More from Infra
- RTX 5090 hotspot hits 98°C in ComfyUI workloads, owner asks for comparisons — HrothgarLover · 2026-10-22
- whatmodel: open-source tool matches local AI models to your RAM and GPU from 22k benchmarks — JeremyCMorgan · 2026-10-22
- 80 hours of expiring H100 up for grabs — but only usable by agents via an MCP server — madeofAjala · 2026-10-22
- Even an RTX PRO 6000 can't replace cloud LLMs, argues Reddit work-usage test — C1rc1es · 2026-10-22
- llama.cpp PR shows R9700 beating strata decode performance — keyboardhack · 2026-10-22
- Flint int4 hits 122.6 tok/s on Mac mini matching Qwen3.6-35B quality at 3.5x speed — _rockt · 2026-10-22