jev-test-impact uses an LLM to pick which tests to run from a Git diff
alchemist-301 · reddit · 2026-09-25
A developer open-sourced jev-test-impact, attacking a common inefficiency in the AI coding era: agents modify code fast, but we still run the entire test suite after every change.
The pipeline: Git diff → static dependency analysis → candidate test files → LLM (Jev) scores candidates → only the selected Vitest/Jest files run. Crucially, the model can only pick from tests discovered locally and never generates arbitrary commands or paths.
- A fully local --static mode enables benchmarking: full suite vs static analysis vs static + LLM scoring
- The author measures regression recall instead of posting flashy "99% fewer tests" numbers that silently miss bugs
- Looking to validate on larger real-world TypeScript repos
More from coding & agent
- Practical guide to shipping MCPs users want: match your dashboard, skip CodeMode, add docs search — teropa · 2026-09-25
- SkillsBench accepted at NeurIPS 2026: 87-task benchmark tests whether agent skills actually help — HanchungLee · 2026-09-25
- Neo Roundtable: a tiny shared conversation layer so ChatGPT, Claude and coding agents stop re-explaining your project — gambit2054 · 2026-09-25
- Dev builds local AI GTM workflow, argues the next platform entry point is hardware-bound — dotey · 2026-09-25
- TypeSafe AI launches Jev, a 'System One' model for bounded decisions in agent runs — hardimanjames · 2026-09-25
- "Astra, get me 99 fishing": one-line prompt sends an AI agent grinding RuneScape — justalexoki · 2026-09-25