Pumpkin: open-source GUI manager gets llama.cpp running in 5 minutes, no terminal needed

gbolgurov · reddit · 2026-10-27

A developer open-sourced Pumpkin, an all-in-one graphical manager for llama.cpp built for his girlfriend who can't use a terminal: it detects your hardware, downloads the right llama.cpp build, and picks a quant that fits your GPU/RAM — install to running model in about 5 minutes (screenshot shows Qwen3.6 35B Q6K at 41.7 tok/s, 14.8/16GB VRAM).

Feature highlights:

Early release, best tested on Ubuntu and Mac; Windows and Android work but are rougher. Free and open source, non-commercial.

Original post →

More from coding & agent

coding & agent channel →