Zig + Metal homebrew engine runs Inkling 2 Mini faster than MLX on Mac

viksit · x · 2026-11-23

@rachpradhan's team wrote their own inference engine in Zig + Metal — no MLX, no Python in the model path — and ran Thinking Machines' Inkling 2 Mini faster than MLX and exo on the same Mac, thanks to their hand-rolled megakernel. Thinking Machines' Inkling-small-2 is also teased as coming soon.

Original post →

More from Infra

Infra channel →