tinyeval: a Bash-only minimal eval framework with a Claude Code skill
criticasterdotcom · reddit · 2026-11-20
A Redditor open-sourced tinyeval, a minimal alternative to bloated eval frameworks. It relies only on Bash and calls your own web framework for any eval logic, keeping things lightweight for humans and agents. It ships a Claude Code skill that instructs Claude to run test cases before and after any prompt or model change; install via /plugin install tinyeval --marketplace evalship-hq/tinyeval or by pointing Claude at the setup.md. Example cases match regex output and judge phrasing, running in seconds. The author is soliciting feedback on gaps and fit.
More from coding & agent
- Fixed-rule scan of 3,631 public MCP servers flags 24 as do-not-use — Minimum-Gift-5217 · 2026-11-20
- Browser MCP benchmark: 176k-565k tokens per bug fix across 5 tools — VisionInBinary · 2026-11-20
- Developer uses Enhanced Radar MCP to monitor his own flight's ATC comms live — massimosgrelli · 2026-11-20
- IBM finds 29 curated agent memory guidelines beat all 199 on AppWorld — shoumikgoswami · 2026-11-20
- Hands-on: Qwen4-Max shows big gains in frontend and agent skills over Qwen3.8-Max — karminski3 · 2026-11-20
- Where does the agent end and plain code begin? One dev's rule for splitting workflows — krunal_builds · 2026-11-20