One 16GB GPU runs songs, voice, images, 720p video and local RAG — all offline and open source

llama-of-death · reddit · 2026-11-16

A Reddit user demonstrates a fully local AI stack running on a single 16GB card (RTX 4070 Ti SUPER, Linux): generating a song, voice, images, a 720p video clip, plus RAG answers over personal documents with page citations. The system is free and open source (github.com/guaardvark/guaardvark) and works fully offline once models are downloaded. Ahead of Black Friday, the author suggests trying the GPU you already own before upgrading.

Original post →

More from coding & agent

coding & agent channel →