10 open-source repos to test your AI agent before your users do
victor_explore · x · 2026-10-14
A curated list of 10 open-source GitHub repos for testing AI agents, with stars checked Oct 2026: Promptfoo (26K, config-based evals + red-teaming), DeepEval (19K, unit tests for LLM apps), SWE-bench (6K, real GitHub issues for coding agents), Harbor (6K, parallel benchmark runner from the Terminal-Bench team), Giskard (6K, bias/security scanning), TruLens (4K, LLM-as-judge step scoring), Inspect (3K, UK AI Security Institute's eval framework), tau2-bench (2K, agent vs simulated customers), Autoevals (1K, ready-made scorers), and Scenario (1K, simulated users test your agent).
More from coding & agent
- exe.dev's first meetup in SF tackles 'Are We Running Too Many Agents?' — zeeg · 2026-10-14
- When Agents Outrun the Org Chart: Mik Kersten's SAFe Summit Keynote — RealGeneKim · 2026-10-14
- Google 提出 Harness²：递归自进化 agent 执行框架，最高涨 11.8 分 — google · 2026-10-14
- Agent Sociodrama: fixing LLM agent teams via social dynamics, up to 83.3pp accuracy gain — nanyang-technological-university-singapore · 2026-10-14
- The Structure Agents Need Isn't Technical — It's Operational — usehive · 2026-10-14
- Claude Code 2.1.299 ships 190 CLI changes, adds idle compaction and --disallow-tools — ClaudeCodeLog · 2026-10-14