AutoRubric 1.7.0 grades images against rubrics and cuts per-criterion cost ~25% with prompt caching
deliprao · x · 2026-11-11
Delip Rao released AutoRubric 1.7.0, adding two key capabilities to the open-source rubric grading tool: image inputs (charts, screenshots, scans can now be judged by LLM judges and decision models against criteria like "both axes labeled with units"), and cheaper per-criterion grading via prompt reordering so provider prompt caches reuse the submission — cutting cost by nearly a quarter for two of three judges in their runs. Misconfigured judges (including out-of-credits accounts) now raise errors instead of abstaining. Install with pip install -U autorubric.
Related event: AutoRubric 1.7.0 Adds Image Grading and Cuts Costs(2 posts)→
More from coding & agent
- Reddit Users Compare Notes on GLM-5.3-flash's Random Coding Mistakes — JustinHoMi · 2026-11-11
- Dev fine-tunes Qwen3-1.7B into a 1.83GB GLB 3D asset coder that runs on CPU — ConfidentDinner6648 · 2026-11-11
- Solo dev shares 20k-word workflow: Opus 5.5 + Seedance 2.5 for 4 viral product videos — dotey · 2026-11-11
- CodeGraph turns codebases into Neo4j graphs so agents can do dependency-aware refactoring — JeremyCMorgan · 2026-11-11
- Primitive imagines guardian agents that enforce team decisions infrastructure-wide — daniel_mac8 · 2026-11-11
- Fable 5.2 builds a visual workspace for watching Claude sub-agents work — FinanceYF5 · 2026-11-11