SetFit recap: 8 examples per class rivals RoBERTa-Large fine-tuned on 3k
tomaarsen · x · 2026-09-04
The author explains SetFit had fallen behind the ecosystem: it wouldn't import with transformers v5, couldn't load models with huggingfacehub v1, warned on every import with Sentence Transformers v5.4+, and crashed on datasets v4 columns — all fixed in v1.2.0 while old versions keep working. How it works: SetFit turns a few labeled sentences into positive/negative pairs, contrastively fine-tunes a Sentence Transformer, and fits a classifier on the embeddings; 8 examples per class rivals RoBERTa-Large fine-tuned on 3k examples.
More from coding & agent
- Hamel Husain on decision models for evals: don't trust the 0.5 threshold default — HamelHusain · 2026-10-21
- HF Staff Open-Sources Self-Iterating 3D Asset Prompt With Vision Critique Loops for Small Quantized Models — mervenoyann · 2026-10-21
- Open models below 4-bit struggle at self-iterating 3D asset generation, HF dev finds — mervenoyann · 2026-10-21
- Developer Moves AI Agents to a Dedicated Linux Workstation Using Incus System Containers — kevinkern · 2026-10-21
- Motion Launches a General Video Agent That Edits Footage and Mimics Any Reference Style — mhdfaran · 2026-10-21
- MCP Platform NitroStack Wins Product Hunt Product of the Day, Focuses on Retention — EstablishmentFun4373 · 2026-10-21