Noob uses ChatGPT to mine papers for speeding up local Gemma 26B on a MacBook

TheMoonMidas · x · 2026-09-02

A self-described noob points ChatGPT at researchers' profiles, GitHub repos and papers, prompting it to "grab all the ideas and see what can be implemented to make this model faster," then has it self-review and keeps pushing. Goal: squeeze max tokens from Gemma (26B A4B) on a MacBook Pro M4 Max 128GB.

Original post →

More from coding & agent

coding & agent channel →