Running BGE-M3 + reranker + TTS in 4GB VRAM and ~300MB RAM

ALexiosK11 · reddit · 2026-11-17

A developer shares how they fit a full RAG pipeline (BGE-M3 embeddings, reranker, Kokoro TTS) into an RTX 3050 laptop with 4GB VRAM for their local reading app Omnitome:

Open source at github.com/ayumu-ml/Omnitome.

Original post →

More from coding & agent

coding & agent channel →