Practical advice on fine-tuning small models: start around 30B, cheap LoRA experiments on one GPU

ziv_ravid · x · 2026-11-19

A Hebrew X thread fragment on training small models on your own data: you don't need a giant general LLM — start around 30B, which still runs on a single GPU and makes LoRA experiments cheap. There's also growing investment in small models specialized for agentic tasks: if your agent has a limited task set, handing work to such a specialist model is worth trying, with similar approaches emerging in vision.

Related event: Practical Guide to Fine-Tuning Small Models(2 posts)→

Original post →

More from coding & agent

coding & agent channel →