Agent auto-optimizes new model 7x to 210 tok/s on Apple Silicon with zero guidance

simonguozirui · x · 2026-11-21

Exolabs says it got access to Thinkymachines' new model on Wednesday, hit 30 tok/s within 3 hours, and 7x that (210 tok/s) a day later. This was a real-world test of its upcoming Apple Silicon inference engine and an agent pipeline that continuously optimizes inference across its Mac fleet. Given no guidance about the looping architecture, the agent built a working implementation on its own, discovered architecture-specific optimizations, improved kernels and fusions, and made better use of DSpark via adaptive drafting.

Original post →

More from coding & agent

coding & agent channel →