Start custom LLMs at 30B: runs on a single GPU and works with LoRA

ziv_ravid · x · 2026-11-20

Ziv Ravid's thread (posts 11-12): across all these cases the idea is the same — train smaller, more efficient models on your own data. For an LLM he'd start at 30B: it still runs on a single GPU and you can run LoRA on it. Small models specializing in agentic tasks are also worth handing limited task sets to.

Original post →

More from coding & agent

coding & agent channel →