Jailbroken PS4 runs a 9B open-source model at up to 43 tok/s by talking directly to its 2013-era GPU

AIFlow_ML · x · 2026-11-16

Tom's Hardware reports that Garlic, an open-source LLM runtime, runs 9-billion-parameter models on a jailbroken PS4 at up to 43 tokens per second. The project bypasses drivers entirely and talks directly to the console's 2013-era GPU, squeezing bare-metal performance out of decade-old hardware — a story about local AI without new GPUs.

Original post →

More from Infra

Infra channel →