Running Gemma inside an office printer: 14MB RAM, 60s per token

TheTuringPost · x · 2026-11-18

osanseviero compiled a small transformer engine + quantized Gemma 3 270m into a single PostScript job with Carbon's help, running 100% inside an office printer: 14MB peak RAM, 60s per token, with layer juggling to avoid OOM. Top reply: "once the ink runs out, it'll refuse to generate the next token."

Original post →

More from coding & agent

coding & agent channel →