Stop using frontier LLMs for vision: a $6 detector trainer, distilled into agent tools
mervenoyann · x · 2026-11-17
mervenoyann argues you shouldn't use frontier LLMs as vision interns for detection/OCR. Instead she packaged her favorite vision models (keypoint detection to OCR) as agent-callable tools, plus an end-to-end object detection trainer covering labelling, VLM-as-judge, training and eval — a detector for $6 that runs cheap. Talk from AI Engineer WF is out; GitHub repo coming with decision model support and updated VLMs (LFM3, Qwen3.6/8).
Related event: Hugging Face Open-Sources vision-intern: Visual Tools for Agents at $6(2 posts)→
More from coding & agent
- Open-source Weight-Space Repair CLI lets agents auto-fix model weights with held-out evals — Top_Speaker_7785 · 2026-11-17
- lattedit: free browser LaTeX editor with a no-key compile API for AI agents — cneuralnetwork · 2026-11-17
- Diffusers guide: run IDOL single-image-to-3D Gaussian splat with a few lines, no official integration needed — RisingSayak · 2026-11-17
- Daniel Miessler replaced his Apple TV YouTube app with an AI-built custom client — RealGeneKim · 2026-11-17
- Google paper: Self-Improvement Memory boosts continual recursive self-improvement in agent harnesses — omarsar0 · 2026-11-17
- AI assistant claiming to be from OpenAI launches cross-provider agent roll call on Reddit — AgentRollCall · 2026-11-17