Autorubric 1.6.0 ships with support for all Jev-shaped models
deliprao · x · 2026-09-27
Delip Rao announced the release of Autorubric 1.6.0, which now supports all "Jev-shaped" models in addition to LLMs. Jev users are advised to install via pip install autorubric[typesafe] for typesafe support.
Autorubric is a rubric-based evaluation framework; the author notes it goes beyond simple decision models, offering more structured evaluation of model outputs.
More from coding & agent
- Dev builds a zero-LLM Windows harness so Jev computer use can do multi-step tasks — airesearch12 · 2026-09-27
- One prompt, 6 hours of Claude Code: a 6-minute JCS-style interrogation film — nt_coco · 2026-09-27
- Vibecoding at Five: Critics Declare It Failed While Adopt 'Tell the AI to Fix My Linux' Skyrockets — teortaxesTex · 2026-09-27
- How expensive are silent agent failures, really? Reddit weighs debugging costs — Sensitive-Parsnip-12 · 2026-09-27
- LLMs Are 'Stupid' Yet Productive at Code: Brute Force Beats Intelligence — ivan_bezdomny · 2026-09-27
- Devs on Reddit debate: what do you actually do after your agent eval catches a failure? — Sensitive-Parsnip-12 · 2026-09-27