SetFit recap: 8 examples per class rivals RoBERTa-Large fine-tuned on 3k
tomaarsen · x · 2026-09-04
The author explains SetFit had fallen behind the ecosystem: it wouldn't import with transformers v5, couldn't load models with huggingfacehub v1, warned on every import with Sentence Transformers v5.4+, and crashed on datasets v4 columns — all fixed in v1.2.0 while old versions keep working. How it works: SetFit turns a few labeled sentences into positive/negative pairs, contrastively fine-tunes a Sentence Transformer, and fits a classifier on the embeddings; 8 examples per class rivals RoBERTa-Large fine-tuned on 3k examples.
More from coding & agent
- Databricks exec: AI coding is a duopoly today, open-source models will make it a triopoly — Yuchenj_UW · 2026-09-05
- The folder is the agent: how one engineer sustainably runs 44 specialized AI agents — danshipper · 2026-09-05
- "The Skill of Writing Code Is No More": Devs Debate What Survives the LLM Era — UhGoomba · 2026-09-05
- ffmpeg-skill turns coding agents into local video editors with a probe-edit-verify workflow — TheMoonMidas · 2026-09-05
- Refero Styles turns 2,000+ real product design systems into DESIGN.md files for AI coding agents — victor_explore · 2026-09-05
- Every's Slack agent end-to-end runs a conference launch across CMS, GitHub, and Stripe — danshipper · 2026-09-05