Autorubric's criterion types map 1:1 to typesafeai Jev's Noul/Score/Choice
IanArawjo · x · 2026-09-21
Ian Arawjo investigated typesafeai's Jev and found its abstraction strikingly similar to autorubric, released 8 months ago and to be presented at COLM: their criterion types map one-to-one to Jev's Noul/Score/Choice categories, suggesting independent convergence on the same eval abstraction.
More from Research
- 200-seat UC Berkeley course on full-stack post-training, RL and applied RSI announced — karinanguyen · 2026-11-12
- NVIDIA's Déjà View: 117M looped transformer matches models 10x larger at 3D reconstruction — NVIDIAAI · 2026-11-12
- OpenAI finds models are getting harder to monitor through their chain-of-thought — xiamengzhou · 2026-11-12
- Show Reddit: ge, a Rust GGUF engine, benchmarks against llama.cpp on a 4GB RTX 3050 — Raptor2496 · 2026-11-12
- 1,500 AI-for-Science Papers in a Week Share One Question: Compared With What? — bravo_abad · 2026-11-12
- AI system proves longstanding quantum computing conjecture in three days, Lean-verified — _arohan_ · 2026-11-12