Practical Guide to Fine-Tuning Small Models

A thread advises starting with 30B models runnable on a single GPU for LoRA experiments, ranking skill distillation as the easiest training method, followed by SFT and distillation plus RL.

2026-11-19 ~ 2026-11-19 · 2 related posts