ColGrep-Agent: a 2B-parameter local semantic-search agent matches 10x larger models on code localization

IgorCarron · x · 2026-10-12

LightOn released a paper (arXiv 2610.05099) and open-source tooling showing small specialized agents can handle file localization for coding agents. Their recipe combines ColGREP (local late-interaction semantic search), weighted SFT on teacher trajectories from a 27B model, and GRPO-based RL on localization quality. Models under 2B parameters hit 76.18 file F1 on SWE-bench Lite and 62.57 on Multi-SWE-bench Flash, matching models 10x their size, while cutting CPU end-to-end latency by 44.1% and tokens by 29.1%, with better cross-language generalization.

Related event: LightOn Open-Sources ColGrep-Agent-2B: A Local 2B Code Search Agent That Cuts API Tokens by 34%(18 posts)→

Original post →

More from coding & agent

coding & agent channel →