SetFit recap: 8 examples per class rivals RoBERTa-Large fine-tuned on 3k
tomaarsen · x · 2026-09-04
The author explains SetFit had fallen behind the ecosystem: it wouldn't import with transformers v5, couldn't load models with huggingfacehub v1, warned on every import with Sentence Transformers v5.4+, and crashed on datasets v4 columns — all fixed in v1.2.0 while old versions keep working. How it works: SetFit turns a few labeled sentences into positive/negative pairs, contrastively fine-tunes a Sentence Transformer, and fits a classifier on the embeddings; 8 examples per class rivals RoBERTa-Large fine-tuned on 3k examples.
More from coding & agent
- Burkov: if you don't interrogate Codex line-by-line at handoff, you get 80%-done work — burkov · 2026-10-21
- Mintlify launches Autopilot, an always-on agent that updates docs as you ship — stuffyokodraws · 2026-10-21
- Skills vs MCP vs RAG vs Memory: the four knowledge layers production agents need — MaryamMiradi · 2026-10-21
- When customer service bans AI agents, one goes incognito to fight Xfinity — MoonL88537 · 2026-10-21
- Every.to publishes raw interviews so readers can agent-check quotes in its Codex story — every · 2026-10-21
- One-prompt Blender: Voyager + Claude Opus 5.5 auto-connects to Blender and Unity — ravisparikh · 2026-10-21