Delip Rao: LLM judge community wrote monolithic prompts for two years until autorubric
deliprao · x · 2026-09-21
Delip Rao notes that the LLM judge community spent two years writing monolithic prompts without structured rubrics until autorubric arrived, and agrees Jev's speed and parallelism are its USP. This comment contextualizes Ian Arawjo's observation that autorubric's criterion types map 1:1 to Jev's Noul/Score/Choice abstraction.
Related event: Delip Rao Slams LLM-as-Judge Community for Monolithic Prompts(2 posts)→
More from coding & agent
- LLMs Are Too Big: Aronchick on Right-Sizing Models for Log Routing — aronchick · 2026-09-22
- AI Comes for the If Statement: Tomasz Tunguz on AI replacing hardcoded rule logic — hardimanjames · 2026-09-22
- MrKan turns AI agents into kanban teammates for managing multiple projects with guardrails — agf2007 · 2026-09-22
- Thorsten Ball: Code Review Will Die, and Unit Tests Might Follow — rseroter · 2026-09-22
- Gemini 6 Pro Suddenly Lost Ability to Audit Vercel-Deployed Projects — aklibf · 2026-09-22
- Tinfield 1 open-weight model claims to beat Claude Opus 4.8 on Terminal-Bench — victormustar · 2026-09-22